The story
Said to be originally US railroad slang, referring to an easy, short haul that paid well. The word gravy by itself was used prior to any attestable use of gravy train to characterize cushy situations. Note also phrases with hog train as a possible source of analogy.
Etymology from Wiktionary, CC BY-SA 4.0.