The story
From the uniform of white shirt and shorts worn by the Victorian Football League (which became the Australian Football League) field umpires. The umpires' uniforms changed to day-glow orange in 2004.
Etymology from Wiktionary, CC BY-SA 4.0.