The story
The expression was used in prizefighting (boxing).
Etymology from Wiktionary, CC BY-SA 4.0.
come to time
Today it means: To come forward in order to resume the contest when the interval allowed for rest is over and time is called. Full definition →