The story
From the idea that the ball passes close enough for the batter to smell it.
Etymology from Wiktionary, CC BY-SA 4.0.
perfume ball
Today it means: A bouncer on or just outside off stump that passes very close to the batter's face. Full definition →