Versioned name: HSwish-4

Category: Activation function

Short description: HSwish takes one input tensor and produces output tensor where the hard version of swish function is applied to the tensor elementwise.

Detailed description: For each element from the input tensor calculates corresponding element in the output tensor with the following formula:

\[HSwish(x) = x \cdot \frac{min(max(x + 3,\ 0),\ 6)}{6}\]

The HSwish operation is introduced in the following article.

Attributes: operation has no attributes.


  • 1: Multidimensional input tensor of type T. Required.


  • 1: The resulting tensor of the same shape and type as input tensor.


  • T: arbitrary supported floating-point type.


<layer ... type="HSwish">
        <port id="0">
        <port id="1">