Supported Operations - by Inference Devices

This page lists operations supported by OpenVINO inference devices. The table presents general information, for a more detailed and most recent listing of operations that are implemented and tested:

See the full conformance report table (static)

See the full conformance report table (dynamic)

Operations

CPU (x86)

GPU

GNA

CPU (Arm®)

Abs

Supported**

Supported

Not Supported

Supported

Acos

Supported**

Supported

Not Supported

Supported****

Acosh

Supported**

Supported

Not Supported

Supported****

Activation-Clamp

Supported***

Supported

Supported

Supported

Activation-ELU

Supported***

Supported

Not Supported

Supported

Activation-Exp

Supported***

Supported

Supported

Supported

Activation-Leaky ReLU

Supported***

Supported

Supported

Not Supported

Activation-Not

Supported***

Supported

Not Supported

Not Supported

Activation-PReLU

Supported***

Supported

Not Supported

Supported

Activation-ReLU

Supported***

Supported

Supported

Supported

Activation-ReLU6

Supported***

Supported

Not Supported

Not Supported

Activation-Sigmoid/Logistic

Supported***

Supported

Supported

Supported

Activation-TanH

Supported***

Supported

Supported

Supported

ArgMax

Supported**

Supported

Not Supported

Not Supported

Asin

Supported**

Supported

Not Supported

Supported****

Asinh

Supported**

Supported

Not Supported

Supported****

Atan

Supported**

Supported

Not Supported

Supported****

Atanh

Supported**

Supported

Not Supported

Supported****

BatchNormalization

Supported

Supported

Not Supported

Supported

BinaryConvolution

Supported

Supported

Not Supported

Not Supported

Broadcast

Supported**

Supported

Not Supported

Supported

Ceil

Supported**

Supported

Not Supported

Supported

Concat

Supported***

Supported

Supported

Supported

Const

Supported

Supported

Supported

Supported

Convolution-Dilated

Supported

Supported

Not Supported

Supported

Convolution-Dilated 3D

Supported

Supported

Not Supported

Not Supported

Convolution-Grouped

Supported

Supported

Not Supported

Supported

Convolution-Grouped 3D

Supported

Supported

Not Supported

Not Supported

Convolution-Ordinary

Supported

Supported

Supported*

Supported

Convolution-Ordinary 3D

Supported

Supported

Not Supported

Not Supported

Cos

Supported**

Supported

Not Supported

Supported****

Cosh

Supported**

Supported

Not Supported

Supported****

Crop

Supported

Supported

Supported

Not Supported

CTCGreedyDecoder

Supported**

Supported**

Not Supported

Supported****

Deconvolution

Supported

Supported

Not Supported

Not Supported

Deconvolution 3D

Supported

Supported

Not Supported

Not Supported

DeformableConvolution

Supported

Supported

Not Supported

Not Supported

DepthToSpace

Supported**

Supported

Not Supported

Supported*

DetectionOutput

Supported**

Supported

Not Supported

Supported****

Eltwise-And

Supported***

Supported

Not Supported

Supported

Eltwise-Add

Supported***

Supported

Not Supported

Supported

Eltwise-Div

Supported***

Supported

Not Supported

Supported

Eltwise-Equal

Supported***

Supported

Not Supported

Supported*

Eltwise-FloorMod

Supported***

Supported

Not Supported

Supported****

Eltwise-Greater

Supported***

Supported

Not Supported

Supported

Eltwise-GreaterEqual

Supported***

Supported

Not Supported

Supported

Eltwise-Less

Supported***

Supported

Not Supported

Supported*

Eltwise-LessEqual

Supported***

Supported

Not Supported

Supported*

Eltwise-LogicalAnd

Supported***

Supported

Not Supported

Supported

Eltwise-LogicalOr

Supported***

Supported

Not Supported

Supported

Eltwise-LogicalXor

Supported***

Supported

Not Supported

Supported

Eltwise-Max

Supported***

Supported

Not Supported

Supported

Eltwise-Min

Supported***

Supported

Not Supported

Supported

Eltwise-Mul

Supported***

Supported

Supported

Supported

Eltwise-NotEqual

Supported***

Supported

Not Supported

Supported*

Eltwise-Pow

Supported***

Supported

Not Supported

Supported

Eltwise-Prod

Supported***

Supported

Supported

Not Supported

Eltwise-SquaredDiff

Supported***

Supported

Not Supported

Supported

Eltwise-Sub

Supported***

Supported

Supported

Supported

Eltwise-Sum

Supported***

Supported

Supported

Supported****

Erf

Supported**

Supported

Not Supported

Supported****

Exp

Supported

Supported

Supported

Supported

FakeQuantize

Supported

Not Supported

Not Supported

Supported*

Fill

Supported**

Not Supported

Not Supported

Not Supported

Flatten

Supported

Supported

Not Supported

Not Supported

Floor

Supported**

Supported

Not Supported

Supported

FullyConnected (Inner Product)

Supported***

Supported

Supported

Supported

Gather

Supported**

Supported

Not Supported

Supported*

GatherTree

Supported**

Not Supported

Not Supported

Supported****

Gemm

Supported

Supported

Not Supported

Not Supported

GRN

Supported**

Supported**

Not Supported

Supported

HardSigmoid

Supported**

Supported

Not Supported

Supported****

Interp

Supported**

Supported**

Not Supported

Supported*

Log

Supported**

Supported

Supported

Supported

LRN (Norm)

Supported

Supported

Not Supported

Supported*

LSTMCell

Supported

Supported

Supported

Supported

GRUCell

Supported

Supported

Supported

Supported

RNNCell

Supported

Supported

Not Supported

Supported

LSTMSequence

Supported

Supported

Supported

Supported****

GRUSequence

Supported

Supported

Supported

Supported****

RNNSequence

Supported

Supported

Not Supported

Supported****

LogSoftmax

Supported**

Supported

Not Supported

Supported

Memory

Supported

Not Supported

Supported

Not Supported

MVN

Supported**

Supported

Not Supported

Supported*

Neg

Supported**

Supported

Not Supported

Supported

NonMaxSuppression

Supported**

Not Supported

Not Supported

Supported****

Normalize

Supported**

Supported

Not Supported

Supported*

OneHot

Supported**

Supported

Not Supported

Supported****

Pad

Supported**

Supported

Not Supported

Supported*

Permute

Supported

Supported

Supported*

Not Supported

Pooling(AVG,MAX)

Supported

Supported

Supported

Supported

Pooling(AVG,MAX) 3D

Supported

Supported

Not Supported

Supported*

Power

Supported**

Supported

Supported*

Supported

PowerFile

Supported**

Not Supported

Not Supported

Not Supported

PriorBox

Supported**

Supported

Not Supported

Supported

PriorBoxClustered

Supported**

Supported**

Not Supported

Supported

Proposal

Supported**

Supported

Not Supported

Supported****

PSROIPooling

Supported**

Supported

Not Supported

Supported****

Range

Supported**

Not Supported

Not Supported

Not Supported

Reciprocal

Supported**

Supported

Not Supported

Not Supported

ReduceAnd

Supported**

Supported

Not Supported

Supported****

ReduceL1

Supported**

Supported

Not Supported

Supported

ReduceL2

Supported**

Supported

Not Supported

Supported

ReduceLogSum

Supported**

Supported

Not Supported

Supported

ReduceLogSumExp

Supported**

Supported

Not Supported

Not Supported

ReduceMax

Supported**

Supported

Not Supported

Supported

ReduceMean

Supported**

Supported

Not Supported

Supported

ReduceMin

Supported**

Supported

Not Supported

Supported

ReduceOr

Supported**

Supported

Not Supported

Supported****

ReduceProd

Supported**

Supported

Not Supported

Supported

ReduceSum

Supported**

Supported

Not Supported

Supported

ReduceSumSquare

Supported**

Supported

Not Supported

Not Supported

RegionYolo

Supported**

Supported

Not Supported

Supported****

ReorgYolo

Supported**

Supported

Not Supported

Supported

Resample

Supported**

Supported

Not Supported

Not Supported

Reshape

Supported***

Supported

Supported

Supported

ReverseSequence

Supported**

Supported

Not Supported

Supported****

RNN

Supported

Not Supported

Not Supported

Supported

ROIPooling

Supported

Supported*

Not Supported

Supported****

ScaleShift

Supported***

Supported

Supported

Not Supported

ScatterUpdate

Supported**

Not Supported

Not Supported

Not Supported

Select

Supported

Supported

Not Supported

Supported

Selu

Supported**

Supported

Not Supported

Supported****

ShuffleChannels

Supported**

Supported

Not Supported

Supported

Sign

Supported**

Supported

Not Supported

Supported

Sin

Supported**

Supported

Not Supported

Supported

Sinh

Supported**

Supported

Not Supported

Supported****

SimplerNMS

Supported**

Supported

Not Supported

Not Supported

Slice

Supported***

Supported

Supported

Not Supported

SoftMax

Supported***

Supported

Not Supported

Supported

Softplus

Supported**

Supported

Not Supported

Supported

Softsign

Supported**

Supported

Supported

Not Supported

SpaceToDepth

Supported**

Not Supported

Not Supported

Supported*

SpatialTransformer

Supported**

Not Supported

Not Supported

Not Supported

Split

Supported***

Supported

Supported

Supported

Squeeze

Supported**

Supported

Supported

Supported

StridedSlice

Supported**

Supported

Not Supported

Supported*

Tan

Supported**

Supported

Not Supported

Supported****

TensorIterator

Supported

Not Supported

Supported

Supported

Tile

Supported***

Supported**

Not Supported

Supported

TopK

Supported**

Supported

Not Supported

Supported****

Unpooling

Not Supported

Supported

Not Supported

Not Supported

Unsqueeze

Supported**

Supported

Supported

Supported

Upsampling

Not Supported

Supported

Not Supported

Not Supported

* - support is limited to the specific parameters.
** - support is implemented via Extensibility mechanism.
*** - supports NCDHW layout.
**** - support is implemented via runtime reference.