The story
Euphemistic variant of for Christ's sake, for God's sake; Pete either invoking Saint Peter or influenced by for pity's sake.
Etymology from Wiktionary, CC BY-SA 4.0.
for Pete's sake
Today it means: Used to express frustration, exasperation, annoyance. Full definition →