The story
Attested since the early 1600s. Policy had the meaning of ‘shrewdness, cunning’ and ‘trick, stratagem’ at the time, so that the saying was originally an oxymoron in the same vein as attack is the best form of defence.
Etymology from Wiktionary, CC BY-SA 4.0.