The story
From blue + goose, in reference to its blue desk adorned with the seal of the president of the United States; the bald eagle displayed prominently on the seal is sometimes affectionately referred to as a goose for comedic effect.
Etymology from Wiktionary, CC BY-SA 4.0.