The story
From the fact that early parachutes were made of silk, produced by silkworms (which are a species of caterpillar).
Etymology from Wiktionary, CC BY-SA 4.0.
Caterpillar Club
Today it means: An informal association of people who have successfully used a parachute to bail out of a disabled aircraft. Full definition →