Meanings
plural rectified linear units
- A unit (artificial neuron) in an artificial neural network that employs a rectifier.
Synonyms: ReLU
- The rectifier function itself.
Synonyms & antonyms
nounA unit (artificial neuron) in an artificial neural network that employs a rectifier.
Origin
Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969
Full word history & related roots →Cite this entry
rectified linear unit. (n.d.). In WatkinsX Dictionary. Retrieved November 3, 2026, from https://dictionary.watkinsx.com/word/rectified%20linear%20unit
“rectified linear unit.” WatkinsX Dictionary, https://dictionary.watkinsx.com/word/rectified%20linear%20unit. Accessed November 3, 2026.
WatkinsX Dictionary, s.v. “rectified linear unit,” accessed November 3, 2026, https://dictionary.watkinsx.com/word/rectified%20linear%20unit.
Source: rectified linear unit on Wiktionary, CC BY-SA 4.0.