SoftSign#
Versioned name: SoftSign-9
Category: Activation function
Short description: SoftSign performs element-wise activation on a given input tensor.
Detailed description:
SoftSign operation is introduced in this article.
SoftSign Activation Function is a neuron activation function based on the mathematical function:
\[SoftSign(x) = \frac{x}{1+|x|}\]
Inputs:
1: data. Input tensor of type T
Outputs:
1: The resulting tensor of the same shape and type as the input tensor.
Types:
T: Arbitrary supported floating-point type.
Example
<layer ... type="SoftSign">
<input>
<port id="0">
<dim>256</dim>
<dim>56</dim>
</port>
</input>
<output>
<port id="1">
<dim>256</dim>
<dim>56</dim>
</port>
</output>
</layer>