The story
From a + mite (“minute arachnid of the order Acarina; anything very small, a minute object, a very little quantity or particle”).
Etymology from Wiktionary, CC BY-SA 4.0.
a mite
Today it means: To a small extent; in a small amount; rather. Full definition →