The story
Probably a variation of frighten the horses of similar meaning, as in "Does it really matter what these affectionate people do? — so long as they don’t do it in the streets and frighten the horses!"
Etymology from Wiktionary, CC BY-SA 4.0.
scare the horses
Today it means: To upset public order, decorum, or conventional values. Full definition →