The story
From the popular derogatory nickname Lollard given to those without an academic background, educated if at all only in English. By the mid-15th century the term lollard had come to mean heretic in general. More in Wikipedia at Lollardy § Etymology. Possibly related to lolling and lollygagging.
Etymology from Wiktionary, CC BY-SA 4.0.