The story
From hedge (“third-rate”) + priest. To imply such a priest "plying one's trade under a hedge." Compare hedge alehouse, hedge whore.
Etymology from Wiktionary, CC BY-SA 4.0.
hedge priest
Today it means: An ignorant itinerant priest. Full definition →