The story
From the notion that secrets are figuratively hidden in the heart which is contained in the breast (“chest”), and that admitting them will cause the heart to become clean and pure.
Etymology from Wiktionary, CC BY-SA 4.0.
make a clean breast
Today it means: Often followed by of: to be honest about something; to confess. Full definition →