The story
In reference to lavatories, an indirection developed under the influence of powder one's nose, a euphemism for using a toilet. Compare boudoir.
Etymology from Wiktionary, CC BY-SA 4.0.
powder room
Today it means: Synonym of ladies' room: a lavatory intended for use by women. Full definition →