Elu

Versioned name: Elu-1

Category: Activation function

Short description: Exponential linear unit element-wise activation function.

Detailed Description

For each element from the input tensor calculates corresponding element in the output tensor with the following formula:

$elu(x) = \left\{\begin{array}{ll} alpha(e^{x} - 1) \quad \mbox{if } x < 0 \\ x \quad \mbox{if } x \geq 0 \end{array}\right.$

Attributes

• alpha
• Description: scale for the negative factor
• Range of values: arbitrary floating point number
• Type: float
• Default value: none
• Required: yes

Inputs:

• 1: Input tensor x of any floating point type. Required.

Outputs:

• 1: Result of Elu function applied to the input tensor x. Floating point tensor with shape and type matching the input tensor.