The story
Said to have originated with the collecting of taxes by John Morton, Archbishop of Canterbury in the late 15th century, who held that a man living modestly must be saving money and could therefore afford taxes, whereas one living extravagantly was obviously rich and could still afford them.
Etymology from Wiktionary, CC BY-SA 4.0.