Assign

Versioned name: Assign-6

Category: Infrastructure

Short description: Assign sets an input value to the variable_id variable.

Detailed description:

ReadValue, Assign, and Variable define a coherent mechanism for reading, writing and storing a memory buffer between inference calls. More details can be found on the State API documentation page.

Assign sets an input value to the variable_id variable. This value will be read by the ReadValue operation on the next inference call if it has not been reset. The operation checks if the shape and type specified in variable_id extend (relax) the shape and type inferred from the 1st input. If not, it returns an error. For example, if the type in the variable is specified as dynamic, it means that any type for 1st input is allowed but if it is specified as f32, only f32 type is allowed.

Only one pair of ReadValue and Assign operations is expected for each Variable in the model.

Attributes:

• variable_id

  • Description: identifier of the variable to be updated

  • Range of values: any non-empty string

  • Type: string

  • Required: yes

Inputs

• 1: new_value - input tensor of any supported type. Required.

Outputs

• 1: tensor with the same shape and type as new_value.

Example

<layer ... type="Assign" ...>
    <data variable_id="lstm_state_1"/>
    <input>
        <port id="0">
            <dim>1</dim>
            <dim>3</dim>
            <dim>224</dim>
            <dim>224</dim>
        </port>
    </input>
</layer>