HSwish#

Versioned name: HSwish-4

Category: Activation function

Short description: HSwish takes one input tensor and produces output tensor where the hard version of swish function is applied to the tensor elementwise.

Detailed description: For each element from the input tensor calculates corresponding element in the output tensor with the following formula:

H S w i s h (x) = x \cdot \frac{m i n (m a x (x + 3, 0), 6)}{6}

The HSwish operation is introduced in the following article.

Attributes: operation has no attributes.

Inputs:

1: Multidimensional input tensor of type T. Required.

Outputs:

1: The resulting tensor of the same shape and type as input tensor.

Types

T: arbitrary supported floating-point type.

Example

<layer ... type="HSwish">
    <input>
        <port id="0">
            <dim>256</dim>
            <dim>56</dim>
        </port>
    </input>
    <output>
        <port id="1">
            <dim>256</dim>
            <dim>56</dim>
        </port>
    </output>
</layer>