Etymology
Today it means: With compunction; guiltily or regretfully. Full definition →
From compunctious + -ly.
Etymology from Wiktionary, CC BY-SA 4.0.