The story
A shortening, first attested in 1850, of poor white trash, which black slaves in the Southern United States were said to call white individuals who worked in servile positions (for example, as butlers).
Etymology from Wiktionary, CC BY-SA 4.0.