rectified linear unit

English edit

Etymology edit

Coined by Vinod Nair and Geoffrey Hinton in 2010 after linear units used earlier. Displaced earlier term "analog threshold element" which hasn't caught on in 1969

Noun edit

rectified linear unit (plural rectified linear units)

  1. A unit (artificial neuron) in an artificial neural network that employs a rectifier
  2. The rectifier function itself

Synonyms edit