The story
From the traditional signal from a boxer's support staff of throwing such an item into a boxing ring to indicate that the contestant cannot continue the match and is forfeiting to the opponent.
Etymology from Wiktionary, CC BY-SA 4.0.
throw in the towel
Today it means: To quit; to give up. Full definition →