The story
From the rules of baseball, where the defending team needs to assign an infielder to each of the three outward-facing bases.
Etymology from Wiktionary, CC BY-SA 4.0.
cover one's bases
Today it means: To be thorough; to prepare thoroughly or completely. Full definition →