Category: Activation function
Short description: ReLU element-wise activation function. (Reference)
Detailed description: Reference
Attributes: ReLU operation has no attributes.
Mathematical Formulation
For each element from the input tensor calculates corresponding element in the output tensor with the following formula:
\[ Y_{i}^{( l )} = max(0, Y_{i}^{( l - 1 )}) \]
Inputs:
Outputs:
Example