SoftMax

Versioned name : SoftMax-8

Category : Activation function

Short description : Reference

Detailed description : Reference

Attributes

  • axis

    • Description : axis represents the axis of which the SoftMax is calculated. Negative value means counting dimensions from the back. axis equal 1 is a default value.

    • Range of values : [-rank, rank - 1]

    • Type : int

    • Default value : 1

    • Required : no

Mathematical Formulation

\[y_{c} = \frac{e^{Z_{c}}}{\sum_{d=1}^{C}e^{Z_{d}}}\]

where \(C\) is a size of tensor along axis dimension.

Inputs :

  • 1 : Input tensor with enough number of dimension to be compatible with axis attribute. Required.

Outputs :

  • 1 : The resulting tensor of the same shape and type as input tensor.

Example

<layer ... type="SoftMax" ... >
    <data axis="1" />
    <input> ... </input>
    <output> ... </output>
</layer>