The story
Because each of the walls in question is located on a side of the court.
Etymology from Wiktionary, CC BY-SA 4.0.
side wall
Today it means: Either of the two parallel walls in a court, perpendicular to the front wall; either of the walls on the side of the court. Full definition →