The story
From the similarity of the control lever in early designs to a toggle.
Etymology from Wiktionary, CC BY-SA 4.0.
toggle switch
Today it means: A switch actuated by moving a small lever; usually an on/off switch with two positions. Full definition →