The story
From the fact that while crows fly to their source of food, their flight bypasses obstacles like rivers and terrain. Compare beeline.
Etymology from Wiktionary, CC BY-SA 4.0.
as the crow flies
Today it means: In a straight line distance between two locations, as opposed to the road distance or over land distance. Full definition →