The story
By surface analysis, per + vagina, parallel to constructions such as per mouth, per nostrils, per rectum, per statute, per ordinance, per tradition, and others. Sometimes viewed as a misconstruction of per vaginam, borrowed directly from Latin.
Etymology from Wiktionary, CC BY-SA 4.0.