The story
Based around the common belief in Celtic and British Isles folklore that fairies were prone to either kidnapping people or robbing them of their wits.
Etymology from Wiktionary, CC BY-SA 4.0.
away with the fairies
Today it means: Not all there; slightly crazy. Full definition →