Etymology
Today it means: A smooth approximation to the rectifier in neural networks; it is the analytic function f(x)= ln (1+eˣ). Full definition →
From soft + plus.
Etymology from Wiktionary, CC BY-SA 4.0.