The story
A pun on beat it (“go away, scram”) and the process of beating eggs in cookery, with a person's shoe seen as a means of departure from a place.
Etymology from Wiktionary, CC BY-SA 4.0.
put an egg in one's shoe and beat it
Today it means: To go away; get lost; scram. Full definition →