The story
Perhaps from the old custom of ladies betting their gloves, expecting to be paid if they won but not to pay if they lost.
Etymology from Wiktionary, CC BY-SA 4.0.
go for the gloves
Today it means: To bet against a racehorse on the chance of its losing, without having the wherewithal to pay if it wins. Full definition →