The story
From King James Bible, Psalms 8:2, "Out of the mouth of babes and sucklings hast thou ordained strength". (Note that mouth is singular in the Biblical verse, and that the usage of this expression differs from the modern proverbial usage.)
Etymology from Wiktionary, CC BY-SA 4.0.