The story
From the scratch drawn in the ground serving as the starting line of a foot race. A runner “starting from scratch” received no handicap, but started at the beginning of the course.
Etymology from Wiktionary, CC BY-SA 4.0.
from scratch
Today it means: From the beginning; starting with no advantage or prior preparation. Full definition →