The story
The expression is reputed to have gone around the colonial clubs of the distant countries of the British Empire in the Victorian period. It came to fame with the publication of the book ODTAA in 1926 by John Masefield.
Etymology from Wiktionary, CC BY-SA 4.0.