The story
Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969
Etymology from Wiktionary, CC BY-SA 4.0.
Today it means: A unit (artificial neuron) in an artificial neural network that employs a rectifier. Full definition →
Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969
Etymology from Wiktionary, CC BY-SA 4.0.