The story
First written as "Heav'n has no Rage, like Love to Hatred turn'd, Nor Hell a Fury, like a Woman scorn'd." in the 1697 play The Mourning Bride (Act III Scene 2) by William Congreve. The modern form with 'hath' instead of 'has' is not Congreve's wording; the phrase is often falsely attributed to Shakespeare or the King James Bible.
Etymology from Wiktionary, CC BY-SA 4.0.