The story
A pun on head out (“depart for another place”) and the idea of a newborn baby emerging headfirst from the womb.
Etymology from Wiktionary, CC BY-SA 4.0.
make like a baby and head out
Today it means: To leave, depart, go out. Full definition →