The story
First use appears c. 1875 in the US. From feist (“a small, aggressive dog”) + -y; the term feist (now rare) itself originally meant “stink”, and earlier “fart”, from Middle English, from Old English, from Proto-Germanic, presumably from Proto-Indo-European – see feist for details.
Etymology from Wiktionary, CC BY-SA 4.0.