The story
The figurative sense reflects that in some times and places, fourth gear was the highest gear that a car could achieve; compare French en quatrième vitesse.
Etymology from Wiktionary, CC BY-SA 4.0.
fourth gear
Today it means: The fourth of the available gears in a transmission or other gearbox. Full definition →