The story
An early reference is from 1888 in "The Gadsbys" by Rudyard Kipling, referring to the effect on the leather of a saddle (or perhaps a crop) of riding a horse as fast as possible.
Etymology from Wiktionary, CC BY-SA 4.0.
hell-for-leather
Today it means: As fast as possible; recklessly fast. Full definition →