The story
The expression originated in Yiddish (פֿון דײַן מויל אין גאָטס אויערן), spoken by Ashkenazi Jews in Europe. It was adopted into English due to the influence of Ashkenazim who immigrated to the United States.
Etymology from Wiktionary, CC BY-SA 4.0.