The story
Unknown. Sometimes claimed to refer to Church taxes paid to Westminster Abbey (originally called Collegiate Church of Saint Peter at Westminster) that were sent to repair St. Paul's Cathedral in the mid 1500s, though records exist of the phrase since about 1450.
Etymology from Wiktionary, CC BY-SA 4.0.