The story
From the image of a group of children playing a sport with a ball that is the exclusive property of one of the participants.
Etymology from Wiktionary, CC BY-SA 4.0.
take one's ball and go home
Today it means: To cease participating in an activity that has turned to one's disadvantage, especially out of spite, or in a way that prevents others from participating as well. Full definition →