The story
From the idea that men who prefer soy to dairy and meat are weak and feminine, and that the naturally occurring phytoestrogen in soy feminizes men; see Soybean § Phytochemicals on WikipediaWikipedia for more.
Etymology from Wiktionary, CC BY-SA 4.0.