AI Models verified for OpenVINO™#

The following is a list of models that have been verified to work with OpenVINO. Note that other models from OpenVINO-supported frameworks may also work properly but have not been tested.

AI Models that run on Intel® Core Ultra™ Processors with OpenVINO™ toolkit:

Category

Topology

Source Framework

Precision

Inferred With

CPU

GPU

NPU

Audio Enhancement

Denoise

tf

FP16

OpenVINO

+

+

+

Audio Enhancement

Denoise

tf

FP16-INT8

OpenVINO

+

+

+

Audio Enhancement

Denoise

tf

FP32

OpenVINO

+

+

+

Large Language Model

GPT-2

onnx

FP16

OpenVINO

+

+

+

Large Language Model

GPT-2

onnx

FP16-INT8

OpenVINO

+

+

Large Language Model

GPT-2

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

Mask-AI-SRGAN

tf

FP32

OpenVINO

+

Spatial Transformer Network

STN

tf

FP16

OpenVINO

+

+

+

Spatial Transformer Network

STN

tf

FP16-INT8

OpenVINO

+

+

+

Spatial Transformer Network

STN

tf

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-LensBlur

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-LensBlur

tf

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-LensBlur

tf

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-MotionBlur

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-MotionBlur

tf

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-MotionBlur

tf

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-Sharpen

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-Sharpen

tf

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

Sharpen-Sharpen

tf

FP32

OpenVINO

+

+

+

Sound Classification

aclnet

onnx

FP16

OpenVINO

+

+

+

Sound Classification

aclnet

onnx

FP32

OpenVINO

+

+

+

Sound Classification

aclnet

onnx

FP16-INT8

OpenVINO

+

+

Sound Classification

aclnet-int8

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

action-recognition-0001

onnx

FP16

OpenVINO

+

+

+

Object Detection

action-recognition-0001

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

albert-base-v2

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

albert-base-v2

onnx

FP32

OpenVINO

+

+

+

Image Classification

alexnet

onnx

FP16

OpenVINO

+

+

+

Image Classification

alexnet

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

alexnet

onnx

FP32

OpenVINO

+

+

+

Image Classification

alexnet

pytorch

FP32

OpenVINO

+

+

+

Image Classification

alexnet

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

anti-spoof-mn3

onnx

FP16

OpenVINO

+

+

+

Image Classification

anti-spoof-mn3

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

anti-spoof-mn3

onnx

FP32

OpenVINO

+

+

+

Image Classification

asl-recognition-0003

onnx

FP16

OpenVINO

+

+

Image Classification

asl-recognition-0003

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

asl-recognition-0003

onnx

FP32

OpenVINO

+

+

Image Classification

asl-recognition-0004

onnx

FP16

OpenVINO

+

+

Image Classification

asl-recognition-0004

onnx

FP32

OpenVINO

+

+

Text Recognition

attention-ocr

tf

FP16

OpenVINO

+

+

+

Text Recognition

attention-ocr

tf

FP32

OpenVINO

+

+

+

Text Recognition

attention-ocr

tf

FP16-INT8

OpenVINO

+

Semantic Segmentation

background-matting-mobilenetv2

onnx

FP16

OpenVINO

+

Semantic Segmentation

background-matting-mobilenetv2

onnx

FP32

OpenVINO

+

Natural Language Processing

bce-embedding-base_v1

pytorch

FP16

OpenVINO

+

+

Natural Language Processing

bce-embedding-base_v1

pytorch

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

began

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

began

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

began

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased-squad2

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased-squad2

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-base-chinese-xnli-zh

tf

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-chinese-xnli-zh

tf

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-base-chinese-xnli-zh

tf

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-base-multilingual-cased

pytorch

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-multilingual-cased

pytorch

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-base-ner

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-ner

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-base-ner

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-base-uncased-mrpc

onnx

FP16

OpenVINO

+

+

Natural Language Processing

bert-base-uncased-mrpc

onnx

FP16-INT8

OpenVINO

+

+

Natural Language Processing

bert-base-uncased-mrpc

onnx

FP32

OpenVINO

+

+

Natural Language Processing

bert-base-uncased-mrpc

pytorch

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-uncased-mrpc

pytorch

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-large-cased

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-large-cased

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-large-cased

onnx

FP32

OpenVINO

+

+

Natural Language Processing

bert-large-uncased

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased

pytorch

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-squad-0001

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-squad-0001

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-squad-emb-0001

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-squad-emb-0001

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-squad-int8-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-0001

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-0001

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-0002

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-0002

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-emb-int8-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bert-small-uncased-whole-word-masking-squad-int8-0002

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

bge-base-en-v1.5

pytorch

FP16

OpenVINO

+

+

Natural Language Processing

bge-base-en-v1.5

pytorch

FP16-INT8

OpenVINO

+

+

+

Image Classification

brain-tumor-segmentation-0002

onnx

FP16

OpenVINO

+

Image Classification

brain-tumor-segmentation-0002

onnx

FP16-INT8

OpenVINO

+

Image Classification

brain-tumor-segmentation-0002

onnx

FP32

OpenVINO

+

Object Detection

cascade_rcnn_resnet101_fpn_1x_coco

onnx

FP16

OpenVINO

+

Object Detection

cascade_rcnn_resnet101_fpn_1x_coco

onnx

FP16-INT8

OpenVINO

+

Object Detection

cascade_rcnn_resnet101_fpn_1x_coco

onnx

FP32

OpenVINO

+

Object Detection

centernet-hg104

tf

FP16

OpenVINO

+

+

Object Detection

centernet-hg104

tf

FP32

OpenVINO

+

Image Classification

clip-vit-b-16-plus-240-laion400m-e32

onnx

FP16

OpenVINO

+

+

+

Image Classification

clip-vit-b-16-plus-240-laion400m-e32

onnx

FP32

OpenVINO

+

+

Image Classification

clip-vit-b-32-laion2b-s34b-b79k

pytorch

FP16

OpenVINO

+

+

Image Classification

clip-vit-b-32-laion2b-s34b-b79k

pytorch

FP16-INT8

OpenVINO

+

+

+

Image Classification

clip-vit-base-patch16

pytorch

FP16-INT8

OpenVINO

+

+

+

Image Classification

clip-vit-base-patch32

pytorch

FP16

OpenVINO

+

+

Colorization

colorization-siggraph

onnx

FP16

OpenVINO

+

+

+

Colorization

colorization-siggraph

onnx

FP16-INT8

OpenVINO

+

+

+

Colorization

colorization-siggraph

onnx

FP32

OpenVINO

+

+

+

Colorization

colorization-v2

onnx

FP16

OpenVINO

+

+

+

Colorization

colorization-v2

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

common-sign-language-0001

onnx

FP16

OpenVINO

+

+

+

Image Classification

common-sign-language-0001

onnx

FP32

OpenVINO

+

+

+

Image Classification

common-sign-language-0002

onnx

FP16

OpenVINO

+

+

+

Image Classification

common-sign-language-0002

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

common-sign-language-0002

onnx

FP32

OpenVINO

+

+

+

Image Classification

convnext-tiny

onnx

FP16

OpenVINO

+

Image Classification

convnext-tiny

onnx

FP32

OpenVINO

+

Image Classification

convnext-tiny

pytorch

FP32

OpenVINO

+

+

+

Image Classification

convnext-tiny

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

corel_nnart_001

onnx

FP16

OpenVINO

+

Image Processing, Enhancement

corel_nnart_001

onnx

FP16-INT8

OpenVINO

+

+

Image Processing, Enhancement

corel_nnart_001

onnx

FP32

OpenVINO

+

Text Recognition

crnn-tf

tf

FP16

OpenVINO

+

+

Text Recognition

crnn-tf

tf

FP16-INT8

OpenVINO

+

+

Text Recognition

crnn-tf

tf

FP32

OpenVINO

+

+

Object Detection

ctdet_coco_dlav0_512

onnx

FP16

OpenVINO

+

+

+

Object Detection

ctdet_coco_dlav0_512

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

ctdet_coco_dlav0_512

onnx

FP32

OpenVINO

+

+

+

Text Detection

ctpn

tf

FP16

OpenVINO

+

+

Text Detection

ctpn

tf

FP16-INT8

OpenVINO

+

+

Text Detection

ctpn

tf

FP32

OpenVINO

+

+

Image Classification

darknet19

tf

FP16

OpenVINO

+

+

+

Image Classification

darknet19

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

darknet19

tf

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

deblurgan-v2

onnx

FP16

OpenVINO

+

+

Image Processing, Enhancement

deblurgan-v2

onnx

FP32

OpenVINO

+

+

Semantic Segmentation

deeplabv3

tf

FP16

OpenVINO

+

+

+

Semantic Segmentation

deeplabv3

tf

FP16-INT8

OpenVINO

+

+

+

Semantic Segmentation

deeplabv3

tf

FP32

OpenVINO

+

+

+

Image Segmentation

deeplabv3-mobilenetv3

onnx

FP16

OpenVINO

+

+

+

Image Segmentation

deeplabv3-mobilenetv3

onnx

FP16-INT8

OpenVINO

+

+

+

Image Segmentation

deeplabv3-mobilenetv3

onnx

FP32

OpenVINO

+

+

DNA Classification

deepvariant_wgs

tf

FP16

OpenVINO

+

+

DNA Classification

deepvariant_wgs

tf

FP16-INT8

OpenVINO

+

+

DNA Classification

deepvariant_wgs

tf

FP32

OpenVINO

+

+

Image Classification

deit-b

onnx

FP16

OpenVINO

+

+

Image Classification

deit-b

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

deit-b

onnx

FP32

OpenVINO

+

+

+

Image Classification

densenet-121

onnx

FP16

OpenVINO

+

+

+

Image Classification

densenet-121

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

densenet-121

onnx

FP32

OpenVINO

+

+

+

Image Classification

densenet-121

tf

FP16

OpenVINO

+

+

+

Image Classification

densenet-121

tf

FP32

OpenVINO

+

+

+

Image Classification

densenet-121

tf2

FP16

OpenVINO

+

+

+

Image Classification

densenet-121

tf2

FP32

OpenVINO

+

+

+

Image Classification

densenet-161

onnx

FP16

OpenVINO

+

+

Image Classification

densenet-161

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

densenet-161

onnx

FP32

OpenVINO

+

+

Image Classification

densenet-161

pytorch

FP32

OpenVINO

+

+

+

Image Classification

densenet-161

pytorch

FP32-INT8

OpenVINO

+

+

Object Detection

detr_resnet50

onnx

FP16

OpenVINO

+

+

+

Object Detection

detr_resnet50

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

detr_resnet50

onnx

FP32

OpenVINO

+

+

+

Behavior / Decision Prediction

dien_alibaba

tf

FP16

OpenVINO

+

+

Behavior / Decision Prediction

dien_alibaba

tf

FP32

OpenVINO

+

+

Speech Recognition

distil-large-v2-genai

pytorch

FP16

OpenVINO

+

+

Speech Recognition

distil-large-v2-genai

pytorch

FP16-INT8

OpenVINO

+

+

Natural Language Processing

distilbert-base-cased

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-cased

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased

pytorch

FP32-INT8

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased-sst-2

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased-sst-2

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

distilbert-base-uncased-sst-2

onnx

FP32

OpenVINO

+

+

+

Image Classification

dla-34

onnx

FP16

OpenVINO

+

+

Image Classification

dla-34

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

dla-34

onnx

FP32

OpenVINO

+

+

Image Classification

dla-34

pytorch

FP32

OpenVINO

+

+

+

Image Classification

dla-34

pytorch

FP32-INT8

OpenVINO

+

+

+

DNA Classification

dna_r9.4.1

onnx

FP16

OpenVINO

+

DNA Classification

dna_r9.4.1

onnx

FP16-INT8

OpenVINO

+

DNA Classification

dna_r9.4.1

onnx

FP32

OpenVINO

+

DNA Classification

dna_r9.4.1_2d

onnx

FP16

OpenVINO

+

DNA Classification

dna_r9.4.1_2d

onnx

FP16-INT8

OpenVINO

+

DNA Classification

dna_r9.4.1_2d

onnx

FP32

OpenVINO

+

Image Classification, Dual Path Network

dpn-68

onnx

FP16

OpenVINO

+

+

+

Image Classification, Dual Path Network

dpn-68

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification, Dual Path Network

dpn-68

onnx

FP32

OpenVINO

+

+

+

Image Classification, Dual Path Network

dpn-68

pytorch

FP32

OpenVINO

+

+

+

Image Classification, Dual Path Network

dpn-68

pytorch

FP32-INT8

OpenVINO

+

+

+

Object Detection

driver-action-recognition-adas-0002

onnx

FP16

OpenVINO

+

+

Object Detection

driver-action-recognition-adas-0002

onnx

FP32

OpenVINO

+

+

Semantic Segmentation

drn-d-38

onnx

FP16

OpenVINO

+

+

Semantic Segmentation

drn-d-38

onnx

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

drn-d-38

onnx

FP32

OpenVINO

+

+

Image Classification

east_resnet_v1_50

tf

FP16

OpenVINO

+

+

+

Image Classification

east_resnet_v1_50

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

east_resnet_v1_50

tf

FP32

OpenVINO

+

+

Image Processing, Enhancement

ebgan

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

ebgan

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

ebgan

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

edsr3-nas

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

edsr3-nas

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

edsr3-nas

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

edsr3_super_resolution

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

edsr3_super_resolution

tf

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

edsr3_super_resolution

tf

FP32

OpenVINO

+

+

+

Object Detection

efficientdet-d0

tf

FP16

OpenVINO

+

+

+

Object Detection

efficientdet-d0

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

efficientdet-d1

tf

FP16

OpenVINO

+

+

+

Image Classification

efficientnet-b0

onnx

FP16

OpenVINO

+

+

+

Image Classification

efficientnet-b0

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

efficientnet-b0

onnx

FP32

OpenVINO

+

+

+

Image Classification

efficientnet-b0

tf

FP16

OpenVINO

+

+

+

Image Classification

efficientnet-b0

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

efficientnet-b0

tf

FP32

OpenVINO

+

+

+

Object Detection

efficientnet-b0_auto_aug

tf

FP16

OpenVINO

+

+

Object Detection

efficientnet-b0_auto_aug

tf

FP16-INT8

OpenVINO

+

+

Object Detection

efficientnet-b0_auto_aug

tf

FP32

OpenVINO

+

+

Image Classification

efficientnet-b3

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

efficientnet-v2-m

onnx

FP16

OpenVINO

+

+

+

Image Classification

efficientnet-v2-m

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

efficientnet-v2-m

onnx

FP32

OpenVINO

+

+

+

Image Classification

efficientnet-v2-m

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

ens3-adv-inception-v3

tf

FP16

OpenVINO

+

+

Image Classification

ens3-adv-inception-v3

tf

FP16-INT8

OpenVINO

+

+

Image Classification

ens3-adv-inception-v3

tf

FP32

OpenVINO

+

+

Image Processing, Enhancement

esrgan

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

esrgan

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

esrgan

onnx

FP32

OpenVINO

+

+

+

Object Detection

face-detection-0200

onnx

FP16

OpenVINO

+

+

+

Object Detection

face-detection-0200

onnx

FP32

OpenVINO

+

+

+

Object Detection

face-detection-0202

onnx

FP16

OpenVINO

+

+

+

Object Detection

face-detection-0202

onnx

FP32

OpenVINO

+

+

+

Object Detection

face-detection-0204

onnx

FP16

OpenVINO

+

+

+

Object Detection

face-detection-0204

onnx

FP32

OpenVINO

+

+

+

Object Detection

face-detection-0205

onnx

FP16

OpenVINO

+

+

Object Detection

face-detection-0205

onnx

FP32

OpenVINO

+

+

Object Detection

face-detection-0206

onnx

FP16

OpenVINO

+

+

Object Detection

face-detection-0206

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

face-detection-0206

onnx

FP32

OpenVINO

+

+

Object Detection

face-detection-retail-0005

onnx

FP16

OpenVINO

+

+

+

Object Detection

face-detection-retail-0005

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

face-detection-retail-0005

onnx

FP32

OpenVINO

+

+

+

Object Detection

face-recognition-resnet100-arcface

onnx

FP16

OpenVINO

+

+

+

Object Detection

face-recognition-resnet100-arcface

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

face-recognition-resnet100-arcface

onnx

FP32

OpenVINO

+

+

+

Object Detection

face-reidentification-retail-0095

onnx

FP16

OpenVINO

+

+

+

Object Detection

face-reidentification-retail-0095

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

face-reidentification-retail-0095

onnx

FP32

OpenVINO

+

+

+

Object Detection

faceboxes

onnx

FP16

OpenVINO

+

+

+

Object Detection

faceboxes

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

faceboxes

onnx

FP32

OpenVINO

+

+

+

Object Detection

facenet

onnx

FP16

OpenVINO

+

+

+

Object Detection

facenet

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

facenet

onnx

FP32

OpenVINO

+

+

+

Object Detection

facenet-20180408-102900

tf

FP16

OpenVINO

+

+

+

Object Detection

facenet-20180408-102900

tf

FP32

OpenVINO

+

+

+

Object Detection

faster_rcnn_inception_resnet_v2_atrous_coco

tf

FP16

OpenVINO

+

+

Object Detection

faster_rcnn_inception_v2_coco

tf

FP16

OpenVINO

+

+

Object Detection

faster_rcnn_resnet101_coco

tf

FP16

OpenVINO

+

+

Object Detection

faster_rcnn_resnet101_kitti

tf

FP16

OpenVINO

+

+

Object Detection

faster_rcnn_resnet50_coco

tf

FP16

OpenVINO

+

+

Object Detection

faster_rcnn_resnet50_coco

tf

FP16-INT8

OpenVINO

+

+

Object Detection

faster_rcnn_resnet50_coco

tf2

FP16

OpenVINO

+

+

Object Detection

faster_rcnn_resnet50_coco

tf2

FP16-INT8

OpenVINO

+

+

Object Detection

faster_rcnn_resnet50_fpn_coco

onnx

FP16

OpenVINO

+

Object Detection

faster_rcnn_resnet50_fpn_coco

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

faster_rcnn_resnet50_fpn_coco

onnx

FP32

OpenVINO

+

Object Detection

faster_rcnn_resnet50_lowproposals_coco

tf

FP16

OpenVINO

+

Semantic Segmentation

fastseg-large

onnx

FP16

OpenVINO

+

+

Semantic Segmentation

fastseg-large

onnx

FP32

OpenVINO

+

+

Semantic Segmentation

fastseg-small

onnx

FP16

OpenVINO

+

+

Semantic Segmentation

fastseg-small

onnx

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

fastseg-small

onnx

FP32

OpenVINO

+

+

Image Processing, Enhancement

fbcnn

onnx

FP16

OpenVINO

+

+

Image Processing, Enhancement

fbcnn

onnx

FP16-INT8

OpenVINO

+

+

Image Processing, Enhancement

fbcnn

onnx

FP32

OpenVINO

+

+

Image Classification

fbnetc-100

onnx

FP16

OpenVINO

+

+

+

Image Classification

fbnetc-100

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

fbnetc-100

onnx

FP32

OpenVINO

+

+

+

Image Classification

fbnetc-100

pytorch

FP32

OpenVINO

+

+

+

Image Classification

fbnetc-100

pytorch

FP32-INT8

OpenVINO

+

+

+

Monodepth

fcrn-dp-nyu-depth-v2-tf

tf

FP16

OpenVINO

+

+

+

Monodepth

fcrn-dp-nyu-depth-v2-tf

tf

FP32

OpenVINO

+

+

+

Text to Speech

forward-tacotron-duration-prediction

onnx

FP16

OpenVINO

+

+

Text to Speech

forward-tacotron-duration-prediction

onnx

FP16-INT8

OpenVINO

+

Text to Speech

forward-tacotron-duration-prediction

onnx

FP32

OpenVINO

+

+

Text to Speech

forward-tacotron-regression

onnx

FP16

OpenVINO

+

+

Text to Speech

forward-tacotron-regression

onnx

FP16-INT8

OpenVINO

+

Text to Speech

forward-tacotron-regression

onnx

FP32

OpenVINO

+

+

Image Processing, Enhancement

fsrcnn-x4

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

fsrcnn-x4

tf

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

fsrcnn-x4

tf

FP32

OpenVINO

+

+

+

Object Detection

gaze-estimation-adas-0002

onnx

FP16

OpenVINO

+

+

+

Object Detection

gaze-estimation-adas-0002

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

gaze-estimation-adas-0002

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

gmcnn-places2

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

gmcnn-places2

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

googlenet-v1

tf

FP16

OpenVINO

+

+

+

Image Classification

googlenet-v1

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

googlenet-v1

tf

FP32

OpenVINO

+

+

+

Image Classification

googlenet-v2

tf

FP16

OpenVINO

+

+

Image Classification

googlenet-v2

tf

FP32

OpenVINO

+

+

Image Classification

googlenet-v3

onnx

FP16

OpenVINO

+

+

+

Image Classification

googlenet-v3

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

googlenet-v3

onnx

FP32

OpenVINO

+

+

+

Image Classification

googlenet-v3

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

googlenet-v3

tf

FP16

OpenVINO

+

+

Image Classification

googlenet-v3

tf

FP32

OpenVINO

+

+

Image Classification

googlenet-v3

tf2

FP16

OpenVINO

+

+

Image Classification

googlenet-v3

tf2

FP32

OpenVINO

+

+

Image Classification

googlenet-v4

tf

FP16

OpenVINO

+

+

+

Image Classification

googlenet-v4

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

googlenet-v4

tf

FP32

OpenVINO

+

+

+

Large Language Model

gpt2-wikitext2-int8-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

Text Detection

handwritten-english-recognition-0001

onnx

FP16

OpenVINO

+

+

+

Text Detection

handwritten-english-recognition-0001

onnx

FP32

OpenVINO

+

+

+

Text Detection

handwritten-japanese-recognition-0001

onnx

FP16

OpenVINO

+

+

+

Text Detection

handwritten-japanese-recognition-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Text Detection

handwritten-japanese-recognition-0001

onnx

FP32

OpenVINO

+

+

+

Text Detection

handwritten-score-recognition-0003

tf

FP16

OpenVINO

+

+

+

Text Detection

handwritten-score-recognition-0003

tf

FP16-INT8

OpenVINO

+

+

+

Text Detection

handwritten-score-recognition-0003

tf

FP32

OpenVINO

+

+

+

Text Detection

handwritten-simplified-chinese-recognition-0001

onnx

FP16

OpenVINO

+

+

+

Text Detection

handwritten-simplified-chinese-recognition-0001

onnx

FP32

OpenVINO

+

+

+

Image Classification

hbonet-0.25

onnx

FP16

OpenVINO

+

+

+

Image Classification

hbonet-0.25

onnx

FP32

OpenVINO

+

+

+

Image Classification

hbonet-0.5

onnx

FP16

OpenVINO

+

+

+

Image Classification

hbonet-0.5

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

hbonet-0.5

onnx

FP32

OpenVINO

+

+

+

Image Classification

hbonet-1.0

onnx

FP16

OpenVINO

+

+

+

Image Classification

hbonet-1.0

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

hbonet-1.0

onnx

FP32

OpenVINO

+

+

+

Object Detection

hg-s8-b1-mpii

onnx

FP16

OpenVINO

+

+

+

Object Detection

hg-s8-b1-mpii

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

hg-s8-b1-mpii

onnx

FP32

OpenVINO

+

+

+

Object Detection

higher-hrnet-w32-512

onnx

FP16

OpenVINO

+

+

Object Detection

higher-hrnet-w32-512

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

higher-hrnet-w32-512

onnx

FP32

OpenVINO

+

+

Text Detection

horizontal-text-detection-0001

onnx

FP16

OpenVINO

+

+

+

Text Detection

horizontal-text-detection-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Text Detection

horizontal-text-detection-0001

onnx

FP32

OpenVINO

+

+

+

Semantic Segmentation

hrnet-v2-c1-segmentation

onnx

FP16

OpenVINO

+

+

+

Semantic Segmentation

hrnet-v2-c1-segmentation

onnx

FP16-INT8

OpenVINO

+

+

+

Semantic Segmentation

hrnet-v2-c1-segmentation

onnx

FP32

OpenVINO

+

+

+

Object Detection

human-pose-estimation-0002

onnx

FP16

OpenVINO

+

+

Object Detection

human-pose-estimation-0002

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

human-pose-estimation-0002

onnx

FP32

OpenVINO

+

+

Object Detection

human-pose-estimation-0003

onnx

FP16

OpenVINO

+

+

Object Detection

human-pose-estimation-0003

onnx

FP32

OpenVINO

+

+

Object Detection

human-pose-estimation-0004

onnx

FP16

OpenVINO

+

+

Object Detection

human-pose-estimation-0004

onnx

FP32

OpenVINO

+

+

Object Detection

human-pose-estimation-0005

onnx

FP16

OpenVINO

+

+

Object Detection

human-pose-estimation-0005

onnx

FP32

OpenVINO

+

+

Object Detection

human-pose-estimation-0006

onnx

FP16

OpenVINO

+

+

Object Detection

human-pose-estimation-0006

onnx

FP32

OpenVINO

+

+

Object Detection

human-pose-estimation-0007

onnx

FP16

OpenVINO

+

+

Object Detection

human-pose-estimation-0007

onnx

FP32

OpenVINO

+

+

Object Detection

human-pose-estimation-3d-0001

onnx

FP16

OpenVINO

+

+

+

Object Detection

human-pose-estimation-3d-0001

onnx

FP32

OpenVINO

+

+

Image Processing, Enhancement

hybrid-cs-model-mri

tf2

FP16

OpenVINO

+

Image Processing, Enhancement

hybrid-cs-model-mri

tf2

FP32

OpenVINO

+

Action Recognition

i3d-flow

tf

FP16

OpenVINO

+

+

Action Recognition

i3d-flow

tf

FP16-INT8

OpenVINO

+

+

Action Recognition

i3d-flow

tf

FP32

OpenVINO

+

+

Action Recognition

i3d-rgb

tf

FP16

OpenVINO

+

+

Action Recognition

i3d-rgb

tf

FP16-INT8

OpenVINO

+

+

Action Recognition

i3d-rgb

tf

FP32

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-ava-0001

tf

FP16

OpenVINO

+

Semantic Segmentation

icnet-camvid-ava-0001

tf

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-ava-0001

tf

FP32

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-ava-sparse-30-0001

tf

FP16

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-ava-sparse-30-0001

tf

FP32

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-ava-sparse-60-0001

tf

FP16

OpenVINO

+

Semantic Segmentation

icnet-camvid-ava-sparse-60-0001

tf

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-ava-sparse-60-0001

tf

FP32

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-onnx-0001

onnx

FP16

OpenVINO

+

+

Semantic Segmentation

icnet-camvid-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

image-retrieval-0001

tf

FP16

OpenVINO

+

+

Image Classification

image-retrieval-0001

tf

FP16-INT8

OpenVINO

+

+

Image Classification

image-retrieval-0001

tf

FP32

OpenVINO

+

+

Image Classification

inception-resnet-v2

tf

FP16

OpenVINO

+

+

Image Classification

inception-resnet-v2

tf

FP16-INT8

OpenVINO

+

+

Image Classification

inception-resnet-v2

tf

FP32

OpenVINO

+

+

Image Classification

inceptionv3-int8-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

Instance Segmentation

instance-segmentation-person-0007

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-person-0007

onnx

FP16-INT8

OpenVINO

+

Instance Segmentation

instance-segmentation-person-0007

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0002

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0002

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0010

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0010

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0050

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0050

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0083

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0083

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0091

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0091

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0228

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-0228

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1025

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1025

onnx

FP16-INT8

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1025

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1039

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1039

onnx

FP32

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1040

onnx

FP16

OpenVINO

+

Instance Segmentation

instance-segmentation-security-1040

onnx

FP32

OpenVINO

+

Video Processing

iseebetter

onnx

FP16

OpenVINO

+

+

Video Processing

iseebetter

onnx

FP16-INT8

OpenVINO

+

+

+

Video Processing

iseebetter

onnx

FP32

OpenVINO

+

+

Natural Language Processing

jina-clip-v1

pytorch

FP16

OpenVINO

+

+

Object Detection

landmarks-regression-retail-0009

onnx

FP16

OpenVINO

+

+

Object Detection

landmarks-regression-retail-0009

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

landmarks-regression-retail-0009

onnx

FP32

OpenVINO

+

+

Image Classification

levit-128s

onnx

FP16

OpenVINO

+

+

Image Classification

levit-128s

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

levit-128s

onnx

FP32

OpenVINO

+

+

Image Classification

levit-128s

pytorch

FP32

OpenVINO

+

+

+

Text Detection

license-plate-recognition-barrier-0007

tf

FP16

OpenVINO

+

+

Text Detection

license-plate-recognition-barrier-0007

tf

FP16-INT8

OpenVINO

+

+

Text Detection

license-plate-recognition-barrier-0007

tf

FP32

OpenVINO

+

+

Image Classification

lraspp-mobilenet-v3-large

onnx

FP16

OpenVINO

+

+

+

Image Classification

lraspp-mobilenet-v3-large

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

lraspp-mobilenet-v3-large

onnx

FP32

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-de-en-0001

onnx

FP16

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-de-en-0001

onnx

FP32

OpenVINO

+

Natural Language Processing

machine-translation-nar-de-en-0002

onnx

FP16

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-de-en-0002

onnx

FP32

OpenVINO

+

Natural Language Processing

machine-translation-nar-en-de-0001

onnx

FP16

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-en-de-0001

onnx

FP32

OpenVINO

+

Natural Language Processing

machine-translation-nar-en-de-0002

onnx

FP16

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-en-de-0002

onnx

FP32

OpenVINO

+

Natural Language Processing

machine-translation-nar-en-ru-0002

onnx

FP16

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-en-ru-0002

onnx

FP32

OpenVINO

+

Natural Language Processing

machine-translation-nar-ru-en-0002

onnx

FP16

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-ru-en-0002

onnx

FP16-INT8

OpenVINO

+

+

Natural Language Processing

machine-translation-nar-ru-en-0002

onnx

FP32

OpenVINO

+

Instance Segmentation

mask_rcnn_inception_resnet_v2_atrous_coco

tf

FP16

OpenVINO

+

+

Instance Segmentation

mask_rcnn_inception_v2_coco

tf

FP16

OpenVINO

+

+

Instance Segmentation

mask_rcnn_inception_v2_coco

tf

FP16-INT8

OpenVINO

+

+

Instance Segmentation

mask_rcnn_resnet101_atrous_coco

tf

FP16

OpenVINO

+

+

Instance Segmentation

mask_rcnn_resnet101_atrous_coco

tf

FP16-INT8

OpenVINO

+

+

Instance Segmentation

mask_rcnn_resnet50_atrous_coco

tf

FP16

OpenVINO

+

+

Instance Segmentation

mask_rcnn_resnet50_atrous_coco

tf

FP16-INT8

OpenVINO

+

+

Monodepth

midasnet

onnx

FP16

OpenVINO

+

+

+

Monodepth

midasnet

onnx

FP16-INT8

OpenVINO

+

+

+

Monodepth

midasnet

onnx

FP32

OpenVINO

+

+

+

Image Classification

mixnet-l

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

mlp-mixer-b16-224-miil

onnx

FP16

OpenVINO

+

+

Image Classification

mlp-mixer-b16-224-miil

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

mlp-mixer-b16-224-miil

onnx

FP32

OpenVINO

+

+

Image Classification

mlp-mixer-b16-224-miil

pytorch

FP32

OpenVINO

+

+

+

Image Classification

mlp-mixer-b16-224-miil

pytorch

FP32-INT8

OpenVINO

+

+

+

Object Detection

mnasnet-0.5

onnx

FP16

OpenVINO

+

+

Object Detection

mnasnet-0.5

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

mnasnet-0.5

onnx

FP32

OpenVINO

+

+

Object Detection

mnasnet-1.0

pytorch

FP32

OpenVINO

+

+

+

Object Detection

mnasnet-1.0

pytorch

FP32-INT8

OpenVINO

+

+

+

Natural Language Processing

mobilebert

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v1-0.25-128

tf

FP16

OpenVINO

+

+

Object Detection

mobilenet-v1-0.25-128

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v1-0.25-128

tf

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v1-1.0-224

tf

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v1-1.0-224

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v1-1.0-224

tf

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v2

onnx

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v2

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v2

onnx

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v2

pytorch

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v2

pytorch

FP32-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v2-1.0-224

tf

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v2-1.0-224

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v2-1.0-224

tf

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

onnx

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

onnx

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

tf

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

tf

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

tf2

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

tf2

FP16-INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

tf2

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v3-small-1.0-224

onnx

FP16

OpenVINO

+

+

Object Detection

mobilenet-v3-small-1.0-224

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

mobilenet-v3-small-1.0-224

onnx

FP32

OpenVINO

+

+

Object Detection

mobilenet-v3-small-1.0-224

tf

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v3-small-1.0-224

tf

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v3-small-1.0-224

tf2

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v3-small-1.0-224

tf2

FP16-INT8

OpenVINO

+

+

Object Detection

mobilenet-v3-small-1.0-224

tf2

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-yolo-v4-syg

tf

FP16-INT8

OpenVINO

+

+

Object Detection

mobilenetv2-int8-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

Background Matting

modnet_photographic_portrait_matting

onnx

FP16

OpenVINO

+

Background Matting

modnet_photographic_portrait_matting

onnx

FP32

OpenVINO

+

+

Background Matting

modnet_webcam_portrait_matting

onnx

FP16-INT8

OpenVINO

+

+

Background Matting

modnet_webcam_portrait_matting

onnx

FP32

OpenVINO

+

+

Speech Recognition

mozilla-deepspeech-0.6.1

tf

FP16

OpenVINO

+

Speech Recognition

mozilla-deepspeech-0.6.1

tf

FP16-INT8

OpenVINO

+

Speech Recognition

mozilla-deepspeech-0.6.1

tf

FP32

OpenVINO

+

Speech Recognition

mozilla-deepspeech-0.7.1

tf

FP16

OpenVINO

+

Speech Recognition

mozilla-deepspeech-0.7.1

tf

FP16-INT8

OpenVINO

+

Speech Recognition

mozilla-deepspeech-0.7.1

tf

FP32

OpenVINO

+

Speech Recognition

mozilla-deepspeech-0.8.2

tf

FP16

OpenVINO

+

+

Speech Recognition

mozilla-deepspeech-0.8.2

tf

FP16-INT8

OpenVINO

+

+

Speech Recognition

mozilla-deepspeech-0.8.2

tf

FP32

OpenVINO

+

+

Object Detection

nanodet-m-1.5x-416

onnx

FP16

OpenVINO

+

+

+

Object Detection

nanodet-m-1.5x-416

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

nanodet-m-1.5x-416

onnx

FP32

OpenVINO

+

+

+

Image Classification

nasnet-a-large-331

tf

FP16

OpenVINO

+

+

+

Image Classification

nasnet-a-large-331

tf

FP16-INT8

OpenVINO

+

+

Image Classification

nasnet-a-large-331

tf

FP32

OpenVINO

+

+

+

Image Classification

nasnet-a-mobile-224

tf

FP16

OpenVINO

+

+

Image Classification

nasnet-a-mobile-224

tf

FP16-INT8

OpenVINO

+

+

Image Classification

nasnet-a-mobile-224

tf

FP32

OpenVINO

+

+

Image Classification

netvlad

tf

FP16

OpenVINO

+

Image Classification

netvlad

tf

FP16-INT8

OpenVINO

+

+

Image Classification

netvlad

tf

FP32

OpenVINO

+

Image Classification

nfnet-f0

onnx

FP16

OpenVINO

+

+

Image Classification

nfnet-f0

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

nfnet-f0

onnx

FP32

OpenVINO

+

+

Image Classification

nfnet-f6

pytorch

FP32

OpenVINO

+

+

Image Classification

nfnet-f6

pytorch

FP32-INT8

OpenVINO

+

+

Audio Enhancement

noise-suppression-denseunet-ll-0001

onnx

FP16

OpenVINO

+

Audio Enhancement

noise-suppression-poconetlike-0001

onnx

FP16

OpenVINO

+

+

Audio Enhancement

noise-suppression-poconetlike-0001

onnx

FP32

OpenVINO

+

Text Detection

ocr-perpetuuiti

tf

FP16

OpenVINO

+

Text Detection

ocr-perpetuuiti

tf

FP16-INT8

OpenVINO

+

Text Detection

ocr-perpetuuiti

tf

FP32

OpenVINO

+

Image Classification

open-closed-eye-0001

onnx

FP16

OpenVINO

+

+

+

Image Classification

open-closed-eye-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

open-closed-eye-0001

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

opennmt-hindi-english

onnx

FP32

OpenVINO

+

+

+

Object Detection

openpose-pose

tf

FP16

OpenVINO

+

Object Detection

openpose-pose

tf

FP16-INT8

OpenVINO

+

Object Detection

openpose-pose

tf

FP32

OpenVINO

+

Object Detection

person-attributes-recognition-crossroad-0230

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0230

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0234

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0234

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0234

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0238

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0238

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

person-attributes-recognition-crossroad-0238

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0100

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-detection-0100

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0101

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-detection-0101

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0102

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-detection-0102

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0106

onnx

FP16

OpenVINO

+

Object Detection

person-detection-0106

onnx

FP32

OpenVINO

+

Object Detection

person-detection-0200

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-detection-0200

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0201

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-detection-0201

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0202

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-detection-0202

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-detection-0203

onnx

FP16

OpenVINO

+

+

Object Detection

person-detection-0203

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

person-detection-0203

onnx

FP32

OpenVINO

+

+

Object Detection

person-detection-0301

onnx

FP16

OpenVINO

+

Object Detection

person-detection-0301

onnx

FP32

OpenVINO

+

Object Detection

person-detection-0302

onnx

FP16

OpenVINO

+

Object Detection

person-detection-0302

onnx

FP32

OpenVINO

+

Object Detection

person-detection-0303

onnx

FP16

OpenVINO

+

+

Object Detection

person-detection-0303

onnx

FP32

OpenVINO

+

Object Detection

person-detection-action-recognition-0006

tf

FP16

OpenVINO

+

+

+

Object Detection

person-detection-action-recognition-0006

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

person-detection-action-recognition-0006

tf

FP32

OpenVINO

+

+

+

Object Detection

person-detection-asl-0001

onnx

FP16

OpenVINO

+

+

Object Detection

person-detection-asl-0001

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

person-detection-asl-0001

onnx

FP32

OpenVINO

+

+

Object Detection

person-reidentification-retail-0248

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0248

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0248

onnx

FP32

OpenVINO

+

+

Object Detection

person-reidentification-retail-0277

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0277

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0286

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0286

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0287

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0287

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0287

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0288

onnx

FP16

OpenVINO

+

+

+

Object Detection

person-reidentification-retail-0288

onnx

FP32

OpenVINO

+

+

+

Object Detection

person-vehicle-bike-detection-2000

onnx

FP16

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2000

onnx

FP32

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2001

onnx

FP16

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2001

onnx

FP32

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2002

onnx

FP16

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2002

onnx

FP32

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2003

onnx

FP16

OpenVINO

+

Object Detection

person-vehicle-bike-detection-2003

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2003

onnx

FP32

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2004

onnx

FP16

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-2004

onnx

FP32

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-crossroad-1016

onnx

FP16

OpenVINO

+

+

Object Detection

person-vehicle-bike-detection-crossroad-1016

onnx

FP32

OpenVINO

+

+

Image Segmentation

pointrend-resnet50-fpn-pytorch

onnx

FP16

OpenVINO

+

Image Segmentation

pointrend-resnet50-fpn-pytorch

onnx

FP16-INT8

OpenVINO

+

Image Segmentation

pointrend-resnet50-fpn-pytorch

onnx

FP32

OpenVINO

+

Object Detection

prnet

tf

FP16

OpenVINO

+

+

+

Object Detection

prnet

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

prnet

tf

FP32

OpenVINO

+

+

+

Object Detection

product-detection-0001

onnx

FP16

OpenVINO

+

+

+

Object Detection

product-detection-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

product-detection-0001

onnx

FP32

OpenVINO

+

+

+

Semantic Segmentation

pspnet-pytorch

onnx

FP16

OpenVINO

+

+

Semantic Segmentation

pspnet-pytorch

onnx

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

pspnet-pytorch

onnx

FP32

OpenVINO

+

+

Speech Recognition

quartznet-15x5-en

onnx

FP16

OpenVINO

+

Speech Recognition

quartznet-15x5-en

onnx

FP16-INT8

OpenVINO

+

Speech Recognition

quartznet-15x5-en

onnx

FP32

OpenVINO

+

Image Processing, Enhancement

rcan

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

rcan

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

rcan

onnx

FP32

OpenVINO

+

+

+

Image Classification

regnetx-3.2gf

onnx

FP16

OpenVINO

+

+

Image Classification

regnetx-3.2gf

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

regnetx-3.2gf

onnx

FP32

OpenVINO

+

+

Image Classification

regnetx-32gf

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

repvgg-a0

onnx

FP16

OpenVINO

+

+

Image Classification

repvgg-a0

onnx

FP32

OpenVINO

+

+

Image Classification

repvgg-b1

onnx

FP16

OpenVINO

+

+

Image Classification

repvgg-b1

onnx

FP32

OpenVINO

+

+

Image Classification

repvgg-b3

onnx

FP16

OpenVINO

+

+

Image Classification

repvgg-b3

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

repvgg-b3

onnx

FP32

OpenVINO

+

+

Image Classification

repvgg-b3

pytorch

FP32

OpenVINO

+

+

+

Image Classification

repvgg-b3

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

resmlp-12-distilled-224

onnx

FP16

OpenVINO

+

+

Image Classification

resmlp-12-distilled-224

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

resmlp-12-distilled-224

onnx

FP32

OpenVINO

+

+

Image Classification

resmlp-12-distilled-224

pytorch

FP32

OpenVINO

+

+

+

Image Classification

resmlp-12-distilled-224

pytorch

FP32-INT8

OpenVINO

+

+

+

Image Classification

resnest-50-pytorch

onnx

FP16

OpenVINO

+

+

Image Classification

resnest-50-pytorch

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

resnest-50-pytorch

onnx

FP32

OpenVINO

+

+

Image Classification

resnet-101

onnx

FP16

OpenVINO

+

+

Image Classification

resnet-101

onnx

FP32

OpenVINO

+

+

Image Classification

resnet-101

tf

FP16

OpenVINO

+

+

+

Image Classification

resnet-101

tf

FP32

OpenVINO

+

+

+

Image Classification

resnet-152

onnx

FP16

OpenVINO

+

+

Image Classification

resnet-152

onnx

FP32

OpenVINO

+

+

Image Classification

resnet-152

tf

FP16

OpenVINO

+

+

+

Image Classification

resnet-152

tf

FP32

OpenVINO

+

+

+

Image Classification

resnet-18

onnx

FP16

OpenVINO

+

+

+

Image Classification

resnet-18

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

resnet-18

onnx

FP32

OpenVINO

+

+

+

Image Classification

resnet-34-pytorch

onnx

FP16

OpenVINO

+

+

Image Classification

resnet-34-pytorch

onnx

FP32

OpenVINO

+

+

Image Classification

resnet-50

onnx

FP16

OpenVINO

+

+

+

Image Classification

resnet-50

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

resnet-50

onnx

FP32

OpenVINO

+

+

+

Image Classification

resnet-50

pytorch

FP16

OpenVINO

+

+

+

Image Classification

resnet-50

pytorch

FP16-INT8

OpenVINO

+

+

+

Image Classification

resnet-50

tf

FP16

OpenVINO

+

+

+

Image Classification

resnet-50

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

resnet-50

tf

FP32

OpenVINO

+

+

+

Image Classification

resnet-50-pytorch

onnx

FP16

OpenVINO

+

+

+

Image Classification

resnet-50-pytorch

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

resnet-50-pytorch

onnx

FP32

OpenVINO

+

+

+

Image Classification

resnet-50-tf

tf

FP16

OpenVINO

+

+

Image Classification

resnet-50-tf

tf

FP16-INT8

OpenVINO

+

+

Image Classification

resnet-50-tf

tf

FP32

OpenVINO

+

+

Image Classification

resnet-50-tf

tf2

FP16

OpenVINO

+

+

Image Classification

resnet-50-tf

tf2

FP16-INT8

OpenVINO

+

+

Image Classification

resnet-50-tf

tf2

FP32

OpenVINO

+

+

Image Classification

resnet18-xnor-binary-onnx-0001

onnx

FP16-INT1

OpenVINO

+

Image Classification

resnet50-binary-0001

onnx

FP16-INT1

OpenVINO

+

Image Classification

resnet50-int8-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

resnext-101-32x8d

onnx

FP16

OpenVINO

+

+

+

Image Classification

resnext-101-32x8d

onnx

FP32

OpenVINO

+

+

+

Image Classification

resnext-101-32x8d

pytorch

FP32

OpenVINO

+

+

+

Image Classification

resnext-101-32x8d

pytorch

FP32-INT8

OpenVINO

+

+

Image Classification

resnext-50-32x4d

onnx

FP16

OpenVINO

+

+

Image Classification

resnext-50-32x4d

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

resnext-50-32x4d

onnx

FP32

OpenVINO

+

+

Image Classification

resnext101-32x16d-swsl

onnx

FP16

OpenVINO

+

+

+

Image Classification

resnext101-32x16d-swsl

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

resnext101-32x16d-swsl

onnx

FP32

OpenVINO

+

+

+

Image Classification

retinaface-resnet50

onnx

FP16

OpenVINO

+

+

Image Classification

retinaface-resnet50

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

retinaface-resnet50

onnx

FP32

OpenVINO

+

+

Image Classification

retinanet

tf2

FP16

OpenVINO

+

+

+

Image Classification

retinanet

tf2

FP32

OpenVINO

+

+

+

Image Classification

retinanet_resnet34

onnx

FP16

OpenVINO

+

+

Image Classification

retinanet_resnet34

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

retinanet_resnet34

onnx

FP32

OpenVINO

+

+

Image Classification

rexnet-v1-x1.0

onnx

FP16

OpenVINO

+

+

Image Classification

rexnet-v1-x1.0

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

rexnet-v1-x1.0

onnx

FP32

OpenVINO

+

+

Image Classification

rfcn-resnet101-coco

tf

FP16

OpenVINO

+

+

Image Classification

rfcn-resnet101-coco

tf

FP16-INT8

OpenVINO

+

+

Speech Recognition

rnnt

onnx

FP16

OpenVINO

+

+

Speech Recognition

rnnt

onnx

FP32

OpenVINO

+

+

Natural Language Processing

roberta-base

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

roberta-base

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

roberta-base

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

roberta-base-mrpc

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

roberta-large

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

roberta-large

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

roberta-large

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

roberta-large

pytorch

FP32-INT8

OpenVINO

+

Natural Language Processing

sbert-base-mean-tokens

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

sbert-base-mean-tokens

onnx

FP16-INT8

OpenVINO

+

+

+

Natural Language Processing

sbert-base-mean-tokens

onnx

FP32

OpenVINO

+

+

+

Image Classification

se-resnext-50

onnx

FP16

OpenVINO

+

+

+

Image Classification

se-resnext-50

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

se-resnext-50

onnx

FP32

OpenVINO

+

+

+

Image Classification

se-resnext-50

tf

FP16

OpenVINO

+

+

+

Image Classification

se-resnext-50

tf

FP32

OpenVINO

+

+

+

Image Classification

shufflenet

onnx

FP16

OpenVINO

+

+

Image Classification

shufflenet

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

shufflenet

onnx

FP32

OpenVINO

+

+

Image Classification

shufflenet-v2-x0.5

onnx

FP16

OpenVINO

+

+

Image Classification

shufflenet-v2-x0.5

onnx

FP32

OpenVINO

+

+

+

Image Classification

shufflenet-v2-x1.0

onnx

FP16

OpenVINO

+

Image Classification

shufflenet-v2-x1.0

onnx

FP16-INT8

OpenVINO

+

Image Classification

shufflenet-v2-x1.0

onnx

FP32

OpenVINO

+

Image Classification

shufflenet-v2-x1.0

onnx

FP16

OpenVINO

+

+

Image Classification

shufflenet-v2-x1.0

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

shufflenet-v2-x1.0

onnx

FP32

OpenVINO

+

+

Image Classification

shufflenet-v2-x1.0

pytorch

FP32

OpenVINO

+

+

Image Classification

shufflenet-v2-x1.0

pytorch

FP32-INT8

OpenVINO

+

+

Image Classification

shufflenet-v2-x1.0

tf

FP16

OpenVINO

+

+

+

Image Classification

shufflenet-v2-x1.0

tf

FP16-INT8

OpenVINO

+

+

+

Image Classification

shufflenet-v2-x1.0

tf

FP32

OpenVINO

+

+

+

Object Detection

single-human-pose-estimation-0001

onnx

FP16

OpenVINO

+

+

+

Object Detection

single-human-pose-estimation-0001

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

single-image-super-resolution-1032

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

single-image-super-resolution-1032

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

single-image-super-resolution-1033

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

single-image-super-resolution-1033

onnx

FP32

OpenVINO

+

+

+

Object Detection

smartlab-object-detection-0001

onnx

FP16

OpenVINO

+

+

+

Object Detection

smartlab-object-detection-0001

onnx

FP32

OpenVINO

+

+

Object Detection

smartlab-object-detection-0002

onnx

FP16

OpenVINO

+

+

+

Object Detection

smartlab-object-detection-0003

onnx

FP16

OpenVINO

+

+

+

Object Detection

smartlab-object-detection-0003

onnx

FP32

OpenVINO

+

+

Object Detection

smartlab-object-detection-0004

onnx

FP16

OpenVINO

+

+

+

Object Detection

smartlab-object-detection-0004

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

spnasnet-100

onnx

FP16

OpenVINO

+

+

Image Classification

spnasnet-100

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

spnasnet-100

onnx

FP32

OpenVINO

+

+

Image Classification

spnasnet-100

pytorch

FP32

OpenVINO

+

+

+

Image Classification

spnasnet-100

pytorch

FP32-INT8

OpenVINO

+

+

Image Classification

squeezenet1.0

onnx

FP16

OpenVINO

+

+

Image Classification

squeezenet1.0

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

squeezenet1.0

onnx

FP32

OpenVINO

+

+

Image Classification

squeezenet1.0

pytorch

FP32

OpenVINO

+

+

Image Classification

squeezenet1.0

pytorch

FP32-INT8

OpenVINO

+

Image Classification

squeezenet1.1

onnx

FP16

OpenVINO

+

+

+

Image Classification

squeezenet1.1

onnx

FP32

OpenVINO

+

+

+

Image Classification

squeezenet1.1-pytorch1.2.0

onnx

FP16

OpenVINO

+

+

Image Classification

squeezenet1.1-pytorch1.2.0

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

squeezenet1.1-pytorch1.2.0

onnx

FP32

OpenVINO

+

+

Image Processing, Enhancement

srgan

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

srgan

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

srgan

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

srgan

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

srgan

tf

FP16-INT8

OpenVINO

+

+

Image Processing, Enhancement

srgan

tf

FP32

OpenVINO

+

+

+

Object Detection

ssd-resnet34-1200

onnx

FP16

OpenVINO

+

+

Object Detection

ssd-resnet34-1200

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

ssd-resnet34-1200

onnx

FP32

OpenVINO

+

+

Object Detection

ssd-resnet34-300x300

tf

FP16

OpenVINO

+

+

+

Object Detection

ssd-resnet34-300x300

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

ssd-resnet34-300x300

tf

FP32

OpenVINO

+

+

+

Object Detection

ssd-vgg16

onnx

FP16

OpenVINO

+

+

+

Object Detection

ssd-vgg16

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

ssd-vgg16

onnx

FP32

OpenVINO

+

+

+

Object Detection

ssd300-int8-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

ssd300-onnx-0001

onnx

FP16

OpenVINO

+

+

+

Object Detection

ssd300-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

ssd300-onnx-0001

onnx

FP32

OpenVINO

+

+

+

Object Detection

ssd_mobilenet_v1_coco

tf

FP16

OpenVINO

+

+

Object Detection

ssd_mobilenet_v1_coco

tf

FP16-INT8

OpenVINO

+

+

Object Detection

ssd_mobilenet_v1_fpn_coco

tf

FP16

OpenVINO

+

+

Object Detection

ssd_mobilenet_v2_coco

tf

FP16

OpenVINO

+

+

Object Detection

ssd_mobilenet_v2_coco

tf

FP16-INT8

OpenVINO

+

+

Object Detection

ssd_resnet50_v1_fpn_coco

tf2

FP16

OpenVINO

+

Object Detection

ssd_resnet50_v1_fpn_coco

tf2

FP16-INT8

OpenVINO

+

+

Object Detection

ssdlite_mobilenet_v2

tf

FP16

OpenVINO

+

+

Object Detection

ssdlite_mobilenet_v2

tf

FP16-INT8

OpenVINO

+

+

Image Processing

style_transfer

onnx

FP16

OpenVINO

+

+

+

Image Processing

style_transfer

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing

style_transfer

onnx

FP32

OpenVINO

+

+

+

Image Processing

stylegan2

tf

FP16

OpenVINO

+

+

Image Processing

stylegan2

tf

FP16-INT8

OpenVINO

+

+

Image Processing

stylegan2

tf

FP32

OpenVINO

+

+

Image Classification

swin-tiny-patch4-window7-224

onnx

FP16

OpenVINO

+

+

+

Image Classification

swin-tiny-patch4-window7-224

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

swin-tiny-patch4-window7-224

onnx

FP32

OpenVINO

+

+

+

Image Classification

swin-tiny-patch4-window7-224

pytorch

FP32

OpenVINO

+

+

Image Classification

t2t-vit-14

onnx

FP16

OpenVINO

+

Image Classification

t2t-vit-14

onnx

FP16-INT8

OpenVINO

+

Image Classification

t2t-vit-14

onnx

FP32

OpenVINO

+

Image Classification

t2t-vit-7

onnx

FP16

OpenVINO

+

+

Image Classification

t2t-vit-7

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

t2t-vit-7

onnx

FP32

OpenVINO

+

+

Text to Speech

tacotron_2

onnx

FP16

OpenVINO

+

+

Text Detection

text-detection-0003

tf

FP16

OpenVINO

+

+

+

Text Detection

text-detection-0003

tf

FP32

OpenVINO

+

+

+

Text Detection

text-detection-0004

tf

FP16

OpenVINO

+

+

+

Text Detection

text-detection-0004

tf

FP16-INT8

OpenVINO

+

+

+

Text Detection

text-detection-0004

tf

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

text-image-super-resolution-0001

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

text-image-super-resolution-0001

onnx

FP32

OpenVINO

+

+

+

Text Detection

text-recognition-0012

tf

FP16

OpenVINO

+

+

+

Text Detection

text-recognition-0012

tf

FP16-INT8

OpenVINO

+

+

+

Text Detection

text-recognition-0012

tf

FP32

OpenVINO

+

+

+

Text Detection

text-recognition-0013

onnx

FP16

OpenVINO

+

+

+

Text Detection

text-recognition-0013

onnx

FP32

OpenVINO

+

+

Text Detection

text-recognition-0014

onnx

FP16

OpenVINO

+

+

+

Text Detection

text-recognition-0014

onnx

FP32

OpenVINO

+

+

Text Detection

text-recognition-0015

onnx

FP16

OpenVINO

+

+

Text Detection

text-recognition-0015

onnx

FP32

OpenVINO

+

+

Text Detection

text-recognition-0016

onnx

FP16

OpenVINO

+

+

Text Detection

text-recognition-0016

onnx

FP32

OpenVINO

+

+

Text Detection

text-recognition-resnet-fc

onnx

FP16

OpenVINO

+

+

+

Text Detection

text-recognition-resnet-fc

onnx

FP32

OpenVINO

+

+

+

Text Detection

text-spotting-0001

onnx

FP16

OpenVINO

+

+

Text Detection

text-spotting-0001

onnx

FP32

OpenVINO

+

Text Detection

text-spotting-0003

onnx

FP16

OpenVINO

+

Text Detection

text-spotting-0003

onnx

FP32

OpenVINO

+

Text Detection

text-spotting-0004

onnx

FP16

OpenVINO

+

Text Detection

text-spotting-0004

onnx

FP32

OpenVINO

+

Text Detection

text-spotting-0005

onnx

FP16

OpenVINO

+

Text Detection

text-spotting-0005

onnx

FP32

OpenVINO

+

Text to Speech

text-to-speech-en-0001

onnx

FP16

OpenVINO

+

Text to Speech

text-to-speech-en-0001

onnx

FP32

OpenVINO

+

Text to Speech

text-to-speech-en-multi-0001

onnx

FP16

OpenVINO

+

Text to Speech

text-to-speech-en-multi-0001

onnx

FP32

OpenVINO

+

Time Series Forecasting

time-series-forecasting-electricity-0001

onnx

FP16

OpenVINO

+

+

+

Time Series Forecasting

time-series-forecasting-electricity-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Time Series Forecasting

time-series-forecasting-electricity-0001

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

tinybert_6layer_768dim_cola

onnx

FP16

OpenVINO

+

+

Natural Language Processing

tinybert_6layer_768dim_cola

onnx

FP16-INT8

OpenVINO

+

+

Natural Language Processing

tinybert_6layer_768dim_cola

onnx

FP32

OpenVINO

+

+

+

Object Detection

tiramisu-fc-densenet-103

tf2

FP16

OpenVINO

+

+

+

Object Detection

tiramisu-fc-densenet-103

tf2

FP16-INT8

OpenVINO

+

+

+

Object Detection

tiramisu-fc-densenet-103

tf2

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

topaz_video_super_resolution

tf

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

topaz_video_super_resolution

tf

FP32

OpenVINO

+

+

+

Image Classification

tresnet-m

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

ultra-lightweight-face-detection-rfb-320

onnx

FP16

OpenVINO

+

+

Object Detection

ultra-lightweight-face-detection-rfb-320

onnx

FP32

OpenVINO

+

+

Object Detection

ultra-lightweight-face-detection-slim-320

onnx

FP16

OpenVINO

+

+

Object Detection

ultra-lightweight-face-detection-slim-320

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

ultra-lightweight-face-detection-slim-320

onnx

FP32

OpenVINO

+

+

Semantic Segmentation

unet-2d

onnx

FP16

OpenVINO

+

+

+

Semantic Segmentation

unet-2d

onnx

FP16-INT8

OpenVINO

+

+

+

Semantic Segmentation

unet-2d

onnx

FP32

OpenVINO

+

+

+

Semantic Segmentation

unet-camvid-int8-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Semantic Segmentation

unet-camvid-onnx-0001

onnx

FP16

OpenVINO

+

+

+

Semantic Segmentation

unet-camvid-onnx-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Semantic Segmentation

unet-camvid-onnx-0001

onnx

FP32

OpenVINO

+

+

+

Semantic Segmentation

unet3d_mlperf

onnx

FP16

OpenVINO

+

+

Semantic Segmentation

unet3d_mlperf

onnx

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

unet3d_mlperf

onnx

FP32

OpenVINO

+

+

Semantic Segmentation

unet3d_mlperf

tf

FP16

OpenVINO

+

+

Semantic Segmentation

unet3d_mlperf

tf

FP16-INT8

OpenVINO

+

+

Semantic Segmentation

unet3d_mlperf

tf

FP32

OpenVINO

+

+

URL Classification

urlnet

tf2

FP16

OpenVINO

+

+

+

URL Classification

urlnet

tf2

FP32

OpenVINO

+

+

+

Image Classification

vehicle-attributes-recognition-barrier-0042

onnx

FP16

OpenVINO

+

+

+

Image Classification

vehicle-attributes-recognition-barrier-0042

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

vehicle-attributes-recognition-barrier-0042

onnx

FP32

OpenVINO

+

+

+

Object Detection

vehicle-detection-0200

onnx

FP16

OpenVINO

+

+

+

Object Detection

vehicle-detection-0200

onnx

FP32

OpenVINO

+

+

+

Object Detection

vehicle-detection-0201

onnx

FP16

OpenVINO

+

+

+

Object Detection

vehicle-detection-0201

onnx

FP32

OpenVINO

+

+

+

Object Detection

vehicle-detection-0202

onnx

FP16

OpenVINO

+

+

+

Object Detection

vehicle-detection-0202

onnx

FP32

OpenVINO

+

+

Image Classification

vehicle-reid-0001

onnx

FP16

OpenVINO

+

+

+

Image Classification

vehicle-reid-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

vehicle-reid-0001

onnx

FP32

OpenVINO

+

+

+

Image Classification

versa

tf

FP16

OpenVINO

+

Image Classification

versa

tf

FP16-INT8

OpenVINO

+

Image Classification

versa

tf

FP32

OpenVINO

+

Object Detection

vfnet-resnet50-fpn-pytorch

onnx

FP16

OpenVINO

+

+

Object Detection

vfnet-resnet50-fpn-pytorch

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

vfnet-resnet50-fpn-pytorch

onnx

FP32

OpenVINO

+

Image Classification

vgg-11-bn

pytorch

FP32

OpenVINO

+

+

Image Classification

vgg-11-bn

pytorch

FP32-INT8

OpenVINO

+

+

Image Classification

vgg-16-bn

onnx

FP16

OpenVINO

+

+

Image Classification

vgg-16-bn

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

vgg-16-bn

onnx

FP32

OpenVINO

+

+

Image Classification

vgg16

onnx

FP16

OpenVINO

+

+

Image Classification

vgg16

onnx

FP16-INT8

OpenVINO

+

+

Image Classification

vgg16

onnx

FP32

OpenVINO

+

+

Image Classification

vgg16

pytorch

FP32

OpenVINO

+

+

Image Classification

vgg16

pytorch

FP32-INT8

OpenVINO

+

+

Image Classification

vgg16

tf

FP16

OpenVINO

+

+

+

Image Classification

vgg16

tf

FP32

OpenVINO

+

+

+

Image Classification

vgg19

onnx

FP16

OpenVINO

+

+

Image Classification

vgg19

onnx

FP32

OpenVINO

+

+

Image Classification

vgg19

tf

FP16

OpenVINO

+

+

+

Image Classification

vgg19

tf

FP32

OpenVINO

+

+

+

Speech Recognition

vggvox

tf

FP16

OpenVINO

+

Speech Recognition

vggvox

tf

FP16-INT8

OpenVINO

+

Speech Recognition

vggvox

tf

FP32

OpenVINO

+

Image Classification

vit-base-16-224

onnx

FP16

OpenVINO

+

Image Classification

vit-base-16-224

onnx

FP16-INT8

OpenVINO

+

Image Classification

vit-base-16-224

onnx

FP32

OpenVINO

+

Image Classification

vit-base-16-224

pytorch

FP32

OpenVINO

+

+

Image Classification

vit-base-16-224

pytorch

FP32-INT8

OpenVINO

+

+

Image Classification

vit-base-patch16-224

pytorch

FP16

OpenVINO

+

+

+

Image Classification

vit-base-patch16-224

pytorch

FP16-INT8

OpenVINO

+

+

+

Text Detection

vitstr-small-patch16-224

onnx

FP16

OpenVINO

+

+

+

Text Detection

vitstr-small-patch16-224

onnx

FP16-INT8

OpenVINO

+

+

+

Text Detection

vitstr-small-patch16-224

onnx

FP32

OpenVINO

+

+

+

Speech Recognition

wav2vec2-base

onnx

FP16

OpenVINO

+

+

Speech Recognition

wav2vec2-base

onnx

FP16-INT8

OpenVINO

+

Speech Recognition

wav2vec2-base

onnx

FP32

OpenVINO

+

+

Text to Speech

wavernn-rnn

onnx

FP16

OpenVINO

+

+

Text to Speech

wavernn-rnn

onnx

FP16-INT8

OpenVINO

+

+

Text to Speech

wavernn-rnn

onnx

FP32

OpenVINO

+

+

Text to Speech

wavernn-upsampler

onnx

FP16

OpenVINO

+

+

+

Text to Speech

wavernn-upsampler

onnx

FP16-INT8

OpenVINO

+

+

+

Text to Speech

wavernn-upsampler

onnx

FP32

OpenVINO

+

+

+

Image Processing, Enhancement

wdsr-small-x4

onnx

FP16

OpenVINO

+

+

+

Image Processing, Enhancement

wdsr-small-x4

onnx

FP16-INT8

OpenVINO

+

+

+

Image Processing, Enhancement

wdsr-small-x4

onnx

FP32

OpenVINO

+

+

+

Image Classification

weld-porosity-detection-0001

onnx

FP16

OpenVINO

+

+

+

Image Classification

weld-porosity-detection-0001

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

weld-porosity-detection-0001

onnx

FP32

OpenVINO

+

+

+

Speech Recognition

whisper-large-v3-genai

pytorch

FP16

OpenVINO

+

+

Speech Recognition

whisper-large-v3-genai

pytorch

FP16-INT8

OpenVINO

+

+

Speech Recognition

whisper-large-v3-turbo-genai

pytorch

FP16

OpenVINO

+

+

Speech Recognition

whisper-large-v3-turbo-genai

pytorch

FP16-INT8

OpenVINO

+

+

Speech Recognition

whisper-tiny-genai

pytorch

FP16

OpenVINO

+

+

Speech Recognition

whisper-tiny-genai

pytorch

FP16-INT8

OpenVINO

+

+

Image Classification

wide-resnet-50-v2

onnx

FP16

OpenVINO

+

+

+

Image Classification

wide-resnet-50-v2

onnx

FP16-INT8

OpenVINO

+

+

+

Image Classification

wide-resnet-50-v2

onnx

FP32

OpenVINO

+

+

+

Image Classification

xcit-nano-12-p16

pytorch

FP32

OpenVINO

+

+

Image Classification

xcit-nano-12-p16

pytorch

FP32-INT8

OpenVINO

+

+

Natural Language Processing

xlm-roberta-base

onnx

FP16

OpenVINO

+

+

+

Natural Language Processing

xlm-roberta-base

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

xlnet

onnx

FP16

OpenVINO

+

+

Natural Language Processing

xlnet

onnx

FP16-INT8

OpenVINO

+

+

Natural Language Processing

xlnet

onnx

FP32

OpenVINO

+

+

Instance Segmentation

yolact-resnet50-fpn-pytorch

onnx

FP16

OpenVINO

+

+

Instance Segmentation

yolact-resnet50-fpn-pytorch

onnx

FP16-INT8

OpenVINO

+

+

+

Instance Segmentation

yolact-resnet50-fpn-pytorch

onnx

FP32

OpenVINO

+

+

Object Detection

yolo-v4-tiny

tf

FP16

OpenVINO

+

+

+

Object Detection

yolo-v4-tiny

tf

FP32

OpenVINO

+

+

+

Object Detection

yolo11

pytorch

FP32

OpenVINO

+

+

Object Detection

yolo11

pytorch

FP32-INT8

OpenVINO

+

Object Detection

yolo_v4

tf

FP16

OpenVINO

+

+

+

Object Detection

yolo_v4

tf

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v4

tf

FP32

OpenVINO

+

+

+

Object Detection

yolo_v4

tf2

FP16

OpenVINO

+

+

+

Object Detection

yolo_v4

tf2

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v4

tf2

FP32

OpenVINO

+

+

+

Object Detection

yolo_v5l

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v5l

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v5l

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v5m

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v5m

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v5m

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v5m-v6

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v5m-v6

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v5m-v6

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v5m6-v6

onnx

FP16

OpenVINO

+

+

Object Detection

yolo_v5m6-v6

onnx

FP32

OpenVINO

+

+

Object Detection

yolo_v5s

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v5s

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v5s

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v5s-v6

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v5s-v6

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v5s-v6

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v5x

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v5x

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v8n

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v8n

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolo_v8n

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolof

onnx

FP16

OpenVINO

+

+

Object Detection

yolof

onnx

FP16-INT8

OpenVINO

+

+

Object Detection

yolof

onnx

FP32

OpenVINO

+

+

Object Detection

yolor_p6

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolor_p6

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolor_p6

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolox-tiny

onnx

FP16

OpenVINO

+

+

Object Detection

yolox-tiny

onnx

FP16-INT8

OpenVINO

+

+

+

Object Detection

yolox-tiny

onnx

FP32

OpenVINO

+

+

Large Language Model

baichuan2-13b-chat

pytorch

FP16

OpenVINO

+

+

Large Language Model

baichuan2-13b-chat

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

baichuan2-13b-chat

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

chatglm3-6b

pytorch

FP16

OpenVINO

+

+

Large Language Model

chatglm3-6b

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

chatglm3-6b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

flan-t5-xxl

pytorch

FP16

OpenVINO

+

+

Large Language Model

flan-t5-xxl

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

flan-t5-xxl

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

gpt-j-6b

pytorch

FP16

OpenVINO

+

+

Large Language Model

gpt-j-6b

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

gpt-j-6b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

llama-2-7b-chat-hf

pytorch

FP16

OpenVINO

+

+

Large Language Model

llama-2-7b-chat-hf

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

llama-2-7b-chat-hf

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

llama-2-7b-chat-hf

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

llama-2-13b-chat-hf

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

llama-3.2-3b-instruct

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

llama-3.2-1b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

llama-3.2-1b-instruct

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

llama-3.2-1b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

llama-3.1-8b-instruct

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

mistral-7b-v0.1

pytorch

FP16

OpenVINO

+

+

Large Language Model

mistral-7b-v0.1

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

mistral-7b-v0.1

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-2

pytorch

FP16

OpenVINO

+

+

Large Language Model

phi-2

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-2

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

stable-diffusion-v1-5

pytorch

FP16

OpenVINO

+

+

Image Generation

stable-diffusion-v1-5

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

stable-diffusion-v1-5

pytorch

INT8-HYBRID

OpenVINO

+

+

Image Generation

sd-turbo

pytorch

FP16

OpenVINO

+

+

Image Generation

sd-turbo

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

sd-turbo

pytorch

INT8-HYBRID

OpenVINO

+

+

Image Generation

stable-diffusion-v2-1

pytorch

FP16

OpenVINO

+

+

Image Generation

stable-diffusion-v2-1

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

stable-diffusion-v2-1

pytorch

INT8-HYBRID

OpenVINO

+

+

Image Generation

stable-diffusion-3.5-large-turbo

pytorch

FP16

OpenVINO

+

+

Image Generation

stable-diffusion-3.5-large-turbo

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

stable-diffusion-3.5-large-turbo

pytorch

INT8-HYBRID

OpenVINO

+

+

Image Generation

stable-diffusion-xl-1.0-inpainting-0.1

pytorch

FP16

OpenVINO

+

+

Image Generation

stable-diffusion-xl-1.0-inpainting-0.1

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

gemma-7b-it

pytorch

FP16

OpenVINO

+

Image Generation

flux.1-schnell

pytorch

INT8-CW

OpenVINO

+

Image Generation

flux.1-schnell

pytorch

INT8-HYBRID

OpenVINO

+

Image Generation

flux.1-schnell

pytorch

INT4-MIXED

OpenVINO

+

Image Generation

flux.1-dev

pytorch

INT8-CW

OpenVINO

+

Image Generation

flux.1-dev

pytorch

INT8-HYBRID

OpenVINO

+

Large Language Model

stable-zephyr-3b-dpo

pytorch

FP16

OpenVINO

+

+

Large Language Model

stable-zephyr-3b-dpo

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

stable-zephyr-3b-dpo

pytorch

INT4-MIXED

OpenVINO

+

+

+

Natural Language Processing

t5-small

pytorch

FP16

OpenVINO

+

+

Large Language Model

gemma-7b-it

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

gemma-7b-it

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

qwen1.5-14b-chat

pytorch

FP16

OpenVINO

+

Large Language Model

qwen1.5-14b-chat

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

qwen1.5-14b-chat

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

qwen2.5-7b-instruct

pytorch

FP16

OpenVINO

+

Large Language Model

qwen2.5-7b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2.5-7b-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

qwen2.5-1.5b-instruct

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

qwen2.5-coder-3b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

qwen2.5-coder-3b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2.5-coder-3b-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

phi-3-mini-4k-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

phi-3-mini-4k-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-3-mini-4k-instruct

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

phi-3-medium-4k-instruct

pytorch

FP16

OpenVINO

+

Large Language Model

phi-3-medium-4k-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

phi-3-medium-4k-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

falcon-7b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

falcon-7b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

falcon-7b-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

stablelm-3b-4e1t

pytorch

FP16

OpenVINO

+

+

Large Language Model

stablelm-3b-4e1t

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

stablelm-3b-4e1t

pytorch

INT4-MIXED

OpenVINO

+

+

+

Image Generation

lcm-dreamshaper-v7

pytorch

FP16

OpenVINO

+

+

Image Generation

lcm-dreamshaper-v7

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

lcm-dreamshaper-v7

pytorch

INT8-HYBRID

OpenVINO

+

+

Image Generation

lcm-sdxl

pytorch

FP16

OpenVINO

+

+

Image Generation

lcm-sdxl

pytorch

INT8-CW

OpenVINO

+

+

Image Generation

lcm-sdxl

pytorch

INT8-HYBRID

OpenVINO

+

+

Large Language Model

starcoder2-15b

pytorch

FP16

OpenVINO

+

Large Language Model

starcoder2-15b

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

starcoder2-15b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

mistral-7b-instruct-v0.3

pytorch

FP16

OpenVINO

+

Large Language Model

mistral-7b-instruct-v0.3

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

mistral-7b-instruct-v0.3

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

phi-3-mini-128k-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

phi-3-mini-128k-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-3-mini-128k-instruct

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

phi-3.5-mini-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

phi-3.5-mini-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-3.5-mini-instruct

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

phi-4-mini-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

phi-4-mini-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-4-mini-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

phi-4

pytorch

FP16

OpenVINO

+

Large Language Model

phi-4

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-4

pytorch

INT8-CW

OpenVINO

+

Large Language Model

phi-4-reasoning

pytorch

FP16

OpenVINO

+

Large Language Model

phi-4-reasoning

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-4-reasoning

pytorch

INT8-CW

OpenVINO

+

Multimodal Large Language Model

phi-4-multimodal-instruct

pytorch

FP16

OpenVINO

+

Multimodal Large Language Model

phi-4-multimodal-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Multimodal Large Language Model

phi-4-multimodal-instruct

pytorch

INT8-CW

OpenVINO

+

+

Image Text to Text

phi-3.5-vision-instruct

pytorch

FP16

OpenVINO

+

Image Text to Text

phi-3.5-vision-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

Image Text to Text

phi-3.5-vision-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

glm-4-9b-chat-hf

pytorch

FP16

OpenVINO

+

Large Language Model

glm-4-9b-chat-hf

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

glm-4-9b-chat-hf

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen2-0.5b

pytorch

FP16

OpenVINO

+

+

Large Language Model

qwen2-0.5b

pytorch

BF16

OpenVINO

+

+

+

Large Language Model

qwen2-0.5b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2-0.5b

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

qwen2-7b-instruct

pytorch

FP16

OpenVINO

+

Large Language Model

qwen2-7b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2-7b-instruct

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen2-7b-instruct

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

qwen2-vl-7b-instruct

pytorch

FP16

OpenVINO

+

Large Language Model

qwen2-vl-7b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2-vl-7b-instruct

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen2.5-vl-3b-instruct

pytorch

FP16

OpenVINO

+

Large Language Model

qwen2.5-vl-3b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2.5-vl-3b-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

afm-4.5b

pytorch

FP16

OpenVINO

+

Large Language Model

minicpm3-4b

pytorch

FP16

OpenVINO

+

Large Language Model

minicpm3-4b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

minicpm3-4b

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

minicpm4-0.5b

pytorch

FP16

OpenVINO

+

+

Large Language Model

minicpm4-0.5b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

minicpm4-0.5b

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

minicpm4-8b

pytorch

FP16

OpenVINO

+

Large Language Model

minicpm4-8b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

minicpm4-8b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

minicpm-v-2_6

pytorch

FP16

OpenVINO

+

Large Language Model

minicpm-v-2_6

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

minicpm-v-2_6

pytorch

INT8-CW

OpenVINO

+

Image Text to Text

internvl2-4b

pytorch

FP16

OpenVINO

+

Image Text to Text

internvl2-4b

pytorch

INT4-MIXED

OpenVINO

+

+

Image Text to Text

internvl2-4b

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

nanollava

pytorch

FP16

OpenVINO

+

+

Large Language Model

nanollava

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

nanollava

pytorch

INT8-CW

OpenVINO

+

+

Speech Recognition

whisper-large-v3

pytorch

FP16

OpenVINO

+

+

Speech Recognition

whisper-large-v3

pytorch

INT4-MIXED

OpenVINO

+

+

Speech Recognition

whisper-large-v3

pytorch

INT8-CW

OpenVINO

+

+

Speech Recognition

whisper-large-v3-turbo

pytorch

FP16

OpenVINO

+

+

Speech Recognition

whisper-large-v3-turbo

pytorch

INT4-MIXED

OpenVINO

+

+

Speech Recognition

whisper-large-v3-turbo

pytorch

INT8-CW

OpenVINO

+

+

Speech Recognition

distil-large-v2

pytorch

FP16

OpenVINO

+

+

Speech Recognition

distil-large-v2

pytorch

INT4-MIXED

OpenVINO

+

+

Speech Recognition

distil-large-v2

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

gemma-2-9b-it

pytorch

FP16

OpenVINO

+

Large Language Model

gemma-2-9b-it

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

gemma-2-9b-it

pytorch

INT8-CW

OpenVINO

+

Large Language Model

gemma-3-1b-it

pytorch

FP16

OpenVINO

+

+

Large Language Model

gemma-3-1b-it

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

gemma-3-1b-it

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

deepseek-r1-distill-llama-8b

pytorch

FP16

OpenVINO

+

Large Language Model

deepseek-r1-distill-llama-8b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

deepseek-r1-distill-llama-8b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

deepseek-r1-distill-llama-8b

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-7b

pytorch

FP16

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-7b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

deepseek-r1-distill-qwen-7b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-7b

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-1.5b

pytorch

FP16

OpenVINO

+

+

Large Language Model

deepseek-r1-distill-qwen-1.5b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

deepseek-r1-distill-qwen-1.5b

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

deepseek-r1-distill-qwen-1.5b

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-14b

pytorch

FP4-NORMALIZED

OpenVINO

+

Natural Language Processing

t5-small

pytorch

INT8-CW

OpenVINO

+

+

Natural Language Processing

t5-small

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

afm-4.5b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

afm-4.5b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

gemma-3-12b-it

pytorch

FP16

OpenVINO

+

Large Language Model

gemma-3-12b-it

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

gemma-3-12b-it

pytorch

INT8-CW

OpenVINO

+

Large Language Model

gemma-3-4b-it

pytorch

FP16

OpenVINO

+

Large Language Model

gemma-3-4b-it

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

gemma-3-4b-it

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

qwen-7b-chat

pytorch

FP4-NORMALIZED

OpenVINO

+

Large Language Model

llama-2-13b-chat-hf

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

llama-3.2-3b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

llama-3-8b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

llama-3.1-8b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

llama-2-13b-chat-hf

pytorch

FP16

OpenVINO

+

+

Large Language Model

llama-2-13b-chat-hf

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

qwen2.5-1.5b-instruct

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

tiny-llama-1.1b-chat

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

llama-3.2-3b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

llama-3.2-3b-instruct

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

llama-3-8b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

llama-3-8b-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

llama-3.1-8b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

llama-3.1-8b-instruct

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

minicpm-1b-sft

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

mixtral-8x7b-v0.1

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

mixtral-8x7b-v0.1

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen2.5-3b-instruct-gptq

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen2.5-1.5b-instruct

pytorch

FP16

OpenVINO

+

+

Large Language Model

qwen2.5-1.5b-instruct

pytorch

INT8-CW

OpenVINO

+

+

+

Large Language Model

qwen3-8b

pytorch

FP16

OpenVINO

+

Large Language Model

qwen3-8b

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

qwen3-8b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen3-30b-a3b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen3-30b-a3b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

mistral-7b-instruct-v0.2

pytorch

FP16

OpenVINO

+

Large Language Model

mistral-7b-instruct-v0.2

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

mistral-7b-instruct-v0.2

pytorch

INT8-CW

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-14b

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

phi-4-mini-reasoning

pytorch

FP16

OpenVINO

+

Large Language Model

phi-4-mini-reasoning

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

phi-4-mini-reasoning

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

qwen2-7b-instruct-gptq

pytorch

INT4-MIXED

OpenVINO

+

+

+

Large Language Model

deepseek-r1-distill-qwen-14b

pytorch

FP16

OpenVINO

+

Large Language Model

deepseek-r1-distill-qwen-14b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen-7b-chat

pytorch

FP16

OpenVINO

+

Large Language Model

starcoder

pytorch

FP16

OpenVINO

+

Large Language Model

gemma-2b-it

pytorch

FP16

OpenVINO

+

Large Language Model

bloomz-7b1

pytorch

FP16

OpenVINO

+

Large Language Model

codellama-7b

pytorch

FP16

OpenVINO

+

Large Language Model

dolly-v2-12b

pytorch

FP16

OpenVINO

+

Large Language Model

pythia-12b

pytorch

FP16

OpenVINO

+

Large Language Model

notus-7b-v1

pytorch

FP16

OpenVINO

+

Large Language Model

qwen2-1.5b

pytorch

FP16

OpenVINO

+

Speech Recognition

whisper-tiny

pytorch

FP16

OpenVINO

+

Large Language Model

gemma-2-2b

pytorch

FP16

OpenVINO

+

Large Language Model

dolly-v2-3b

pytorch

FP16

OpenVINO

+

Large Language Model

pythia-12b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

tiny-llama-1.1b-chat

pytorch

FP16

OpenVINO

+

Large Language Model

baichuan2-7b-chat

pytorch

FP16

OpenVINO

+

Large Language Model

baichuan2-7b-chat

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

baichuan2-7b-chat

pytorch

INT8-CW

OpenVINO

+

Large Language Model

dolly-v2-3b

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

dolly-v2-3b

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

zephyr-7b-beta

pytorch

FP16

OpenVINO

+

Large Language Model

zephyr-7b-beta

pytorch

INT8-CW

OpenVINO

+

Large Language Model

zephyr-7b-beta

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

qwen-7b-chat

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen-7b-chat

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

starcoder

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

starcoder

pytorch

INT8-CW

OpenVINO

+

Large Language Model

gemma-2b-it

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

gemma-2b-it

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

mpt-30b-chat

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

mpt-30b-chat

pytorch

INT8-CW

OpenVINO

+

Large Language Model

bloomz-1b4-zh

pytorch

FP16

OpenVINO

+

Large Language Model

bloomz-1b4-zh

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

bloomz-1b4-zh

pytorch

INT8-CW

OpenVINO

+

Large Language Model

bloomz-7b1

pytorch

INT8-CW

OpenVINO

+

Large Language Model

bloomz-7b1

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

codellama-7b

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

codellama-7b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

codet5-base-sum

pytorch

FP16

OpenVINO

+

Large Language Model

codet5-base-sum

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

codet5-base-sum

pytorch

INT8-CW

OpenVINO

+

Large Language Model

dolly-v2-12b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

dolly-v2-12b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

falcon-40b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

flan-t5-large-grammar-synthesis

pytorch

FP16

OpenVINO

+

Large Language Model

flan-t5-large-grammar-synthesis

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

flan-t5-large-grammar-synthesis

pytorch

INT8-CW

OpenVINO

+

Large Language Model

pythia-12b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

gpt-neox-20b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

gpt-neox-20b

pytorch

INT8-CW

OpenVINO

+

Large Language Model

tiny-llama-1.1b-chat

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

neural-chat-7b-v3-3

pytorch

FP16

OpenVINO

+

Large Language Model

neural-chat-7b-v3-3

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

neural-chat-7b-v3-3

pytorch

INT8-CW

OpenVINO

+

Large Language Model

notus-7b-v1

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

notus-7b-v1

pytorch

INT8-CW

OpenVINO

+

Large Language Model

qwen2-1.5b

pytorch

INT4-MIXED

OpenVINO

+

+

Large Language Model

qwen2-1.5b

pytorch

INT8-CW

OpenVINO

+

+

Large Language Model

minicpm-1b-sft

pytorch

FP16

OpenVINO

+

Large Language Model

minicpm-1b-sft

pytorch

INT8-CW

OpenVINO

+

+

Speech Recognition

whisper-tiny

pytorch

INT4-MIXED

OpenVINO

+

Speech Recognition

whisper-tiny

pytorch

INT8-CW

OpenVINO

+

Large Language Model

gemma-2-2b

pytorch

INT4-MIXED

OpenVINO

+

Large Language Model

gemma-2-2b

pytorch

INT8-CW

OpenVINO

+

Natural Language Processing

albert-base-v2

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

albert-large-v2

pytorch

FP32

torch.compile

+

+

+

Image Classification

alexnet

pytorch

FP32

torch.compile

+

+

+

Video Processing

Background_Matting

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bart-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

barthez-orangesum-abstract

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

BERT_pytorch

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-arabertv02

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-cased

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-multilingual-cased

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-NER

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-uncased

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-uncased-mrpc

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-base-uncased-sparse-70-unstructured

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-large-cased

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-large-uncased

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bigbird-pegasus-large-arxiv

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

bigbird-roberta-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

Bio_ClinicalBERT

pytorch

FP32

torch.compile

+

+

+

Large Language Model

bloom

pytorch

FP32

torch.compile

+

+

+

Image Classification

botnet26t_256

pytorch

FP32

torch.compile

+

+

+

Image Classification

cait_s24_224

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

camembert-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

canine-s

pytorch

FP32

torch.compile

+

+

+

Object Detection

cascade_mask_rcnn_R_50_FPN_1x

pytorch

FP32

torch.compile

+

Natural Language Processing

chinese_pretrain_mrc_macbert_large

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

chinese-xlnet-base

pytorch

FP32

torch.compile

+

+

Image Classification

clip-vit-base-patch32

pytorch

FP32

torch.compile

+

+

+

Image Classification

coat_mini

pytorch

FP32

torch.compile

+

+

+

Image Classification

coatnet_1_rw_224.sw_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

coatnet_rmlp_2_rw_224.sw_in12k_ft_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

coatnext_nano_rw_224.sw_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

convit_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

convmixer_1024_20_ks9_p14

pytorch

FP32

torch.compile

+

+

+

Image Classification

convnext_base

pytorch

FP32

torch.compile

+

+

+

Image Classification

convnext_large

pytorch

FP32

torch.compile

+

+

+

Image Classification

convnext_large.fb_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

convnext_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

convnext_tiny

pytorch

FP32

torch.compile

+

+

+

Image Classification

convnextv2_large.fcmae_ft_in22k_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

cs3darknet_focus_m

pytorch

FP32

torch.compile

+

+

+

Image Classification

cs3darknet_m

pytorch

FP32

torch.compile

+

+

+

Image Classification

cs3edgenet_x

pytorch

FP32

torch.compile

+

+

+

Image Classification

cs3se_edgenet_x

pytorch

FP32

torch.compile

+

+

+

Image Classification

cs3sedarknet_l

pytorch

FP32

torch.compile

+

+

+

Image Classification

cspdarknet53

pytorch

FP32

torch.compile

+

+

+

Image Classification

cspresnet50

pytorch

FP32

torch.compile

+

+

+

Image Classification

cspresnext50

pytorch

FP32

torch.compile

+

+

+

Image Classification

darknet53

pytorch

FP32

torch.compile

+

+

+

Image Generation

dcgan

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

deberta-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

deberta-large

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

deberta-v2-xlarge

pytorch

FP32

torch.compile

+

+

+

Semantic Segmentation

deeplabv3_mobilenet_v3_large

pytorch

FP32

torch.compile

+

+

+

Semantic Segmentation

deeplabv3_resnet101

pytorch

FP32

torch.compile

+

+

+

Semantic Segmentation

deeplabv3_resnet50

pytorch

FP32

torch.compile

+

+

+

Audio Enhancement

demucs

pytorch

FP32

torch.compile

+

+

+

Image Classification

densenet121

pytorch

FP32

torch.compile

+

+

+

Image Classification

densenet161

pytorch

FP32

torch.compile

+

+

+

Image Classification

densenet169

pytorch

FP32

torch.compile

+

+

+

Image Classification

densenet201

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

distilbert-base-cased

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

distilbert-base-uncased

pytorch

FP32

torch.compile

+

+

+

Large Language Model

distilbert-base-uncased-distilled-squad

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

distilbert-base-uncased-finetuned-sst-2-english

pytorch

FP32

torch.compile

+

+

+

Image Classification

dla34

pytorch

FP32

torch.compile

+

+

+

Image Classification

dla60_res2net

pytorch

FP32

torch.compile

+

+

+

Image Classification

dla60_res2next

pytorch

FP32

torch.compile

+

+

+

Image Classification

dla60x

pytorch

FP32

torch.compile

+

+

+

Image Classification

dm_nfnet_f6

pytorch

FP32

torch.compile

+

+

+

Image Classification

dm_nfnet_f6.dm_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

dpn68

pytorch

FP32

torch.compile

+

+

+

Image Classification

eca_botnext26ts_256

pytorch

FP32

torch.compile

+

+

+

Image Classification

eca_halonext26ts

pytorch

FP32

torch.compile

+

+

+

Image Classification

eca_nfnet_l1

pytorch

FP32

torch.compile

+

+

+

Image Classification

ecaresnet50d

pytorch

FP32

torch.compile

+

+

+

Image Classification

edgenext_small_rw

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientformer_l3.snap_dist_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientformerv2_s1.snap_dist_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b0

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b1

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b2

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b3

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b4

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b5

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b6

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_b7

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_v2_l

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_v2_m

pytorch

FP32

torch.compile

+

+

+

Image Classification

efficientnet_v2_s

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

electra-base-generator

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

electra-base-squad2

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

electra-small-discriminator

pytorch

FP32

torch.compile

+

+

+

Image Classification

ens_adv_inception_resnet_v2

pytorch

FP32

torch.compile

+

+

+

Image Classification

ese_vovnet39b

pytorch

FP32

torch.compile

+

+

Image Segmentation

facebookresearch_sam2_base

pytorch

FP32

torch.compile

+

+

Image Segmentation

facebookresearch_sam2_large

pytorch

FP32

torch.compile

+

+

Image Segmentation

facebookresearch_sam2_small

pytorch

FP32

torch.compile

+

+

+

Image Segmentation

facebookresearch_sam2_tiny

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

fairseq_s2t_covost

pytorch

FP32

torch.compile

+

+

Object Detection

faster_rcnn_R_50_C4

pytorch

FP32

torch.compile

+

Object Detection

faster_rcnn_R_50_DC5_1x

pytorch

FP32

torch.compile

+

Object Detection

faster_rcnn_R_50_FPN_1x

pytorch

FP32

torch.compile

+

Object Detection

faster_rcnn_R_50_FPN_noaug_1x

pytorch

FP32

torch.compile

+

Object Detection

faster_rcnn_X_101_32x8d_FPN_3x

pytorch

FP32

torch.compile

+

Object Detection

fasterrcnn_mobilenet_v3_large_320_fpn

pytorch

FP32

torch.compile

+

+

Object Detection

fasterrcnn_mobilenet_v3_large_fpn

pytorch

FP32

torch.compile

+

+

Object Detection

fasterrcnn_resnet50_fpn

pytorch

FP32

torch.compile

+

+

+

Image Segmentation

fcn_resnet101

pytorch

FP32

torch.compile

+

+

+

Image Segmentation

fcn_resnet50

pytorch

FP32

torch.compile

+

+

+

Object Detection

fcos_resnet50_fpn

pytorch

FP32

torch.compile

+

+

+

Large Language Model

flan-t5-large-grammar-synthesis

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

fnet-base

pytorch

FP32

torch.compile

+

+

+

Text Recognition

functorch_maml_omniglot

pytorch

FP32

torch.compile

+

+

+

Image Classification

gcresnet50t

pytorch

FP32

torch.compile

+

+

+

Image Classification

gcvit_tiny

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

gelectra-base-germanquad

pytorch

FP32

torch.compile

+

+

+

Image Classification

gernet_m

pytorch

FP32

torch.compile

+

+

+

Image Classification

gluon_inception_v3

pytorch

FP32

torch.compile

+

+

+

Image Classification

gluon_resnet50_v1b

pytorch

FP32

torch.compile

+

+

+

Image Classification

gluon_resnext50_32x4d

pytorch

FP32

torch.compile

+

+

+

Image Classification

gluon_senet154

pytorch

FP32

torch.compile

+

+

+

Image Classification

gluon_seresnext101_64x4d

pytorch

FP32

torch.compile

+

+

+

Image Classification

gmixer_24_224

pytorch

FP32

torch.compile

+

+

+

Image Classification

gmlp_s16_224

pytorch

FP32

torch.compile

+

+

+

Image Classification

googlenet

pytorch

FP32

torch.compile

+

+

Large Language Model

gpt2

pytorch

FP32

torch.compile

+

+

+

Image Classification

halo2botnet50ts_256

pytorch

FP32

torch.compile

+

+

+

Image Classification

halonet50ts

pytorch

FP32

torch.compile

+

+

+

Image Classification

haloregnetz_b

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

Albert

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

Bert

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

Bert_large

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

BigBird

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

DistilBert

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

Longformer

pytorch

FP32

torch.compile

+

+

Text to Speech

hifigan_v1

pytorch

FP32

torch.compile

+

+

+

Image Classification

hrnet_w32

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

ibert-roberta-base

pytorch

FP32

torch.compile

+

+

+

Video Processing

IFRNet_GoPro

pytorch

FP32

torch.compile

+

+

+

Video Processing

IFRNet_Vimeo90K

pytorch

FP32

torch.compile

+

+

+

Image Classification

ig_resnext101_32x8d

pytorch

FP32

torch.compile

+

+

+

Image Classification

inception_resnet_v2

pytorch

FP32

torch.compile

+

+

+

Image Classification

inception_v3

pytorch

FP32

torch.compile

+

+

+

Image Classification

inception_v4

pytorch

FP32

torch.compile

+

+

+

Image Classification

jx_nest_small

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

kcbert-base

pytorch

FP32

torch.compile

+

+

+

Object Detection

keypoint_rcnn_R_50_FPN_1x

pytorch

FP32

torch.compile

+

Object Detection

keypointrcnn_resnet50_fpn

pytorch

FP32

torch.compile

+

+

+

Image Classification

lambda_resnet50ts

pytorch

FP32

torch.compile

+

+

Image Classification

lamhalobotnet50ts_256

pytorch

FP32

torch.compile

+

+

Natural Language Processing

layoutlm-base-uncased

pytorch

FP32

torch.compile

+

+

+

Image to Image

LearningToPaint

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

led-base-16384

pytorch

FP32

torch.compile

+

+

+

Image Classification

legacy_senet154

pytorch

FP32

torch.compile

+

+

Image Classification

legacy_seresnet34

pytorch

FP32

torch.compile

+

+

Image Classification

legacy_seresnext50_32x4d

pytorch

FP32

torch.compile

+

+

Natural Language Processing

legal-bert-base-uncased

pytorch

FP32

torch.compile

+

+

+

Particle Interaction

lennard_jones

pytorch

FP32

torch.compile

+

+

+

Image Classification

levit_128s.fb_dist_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

levit_conv_128.fb_dist_in1k

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

longformer-base-4096

pytorch

FP32

torch.compile

+

+

Image Classification

lraspp_mobilenet_v3_large

pytorch

FP32

torch.compile

+

+

+

Text Recognition

maml_omniglot

pytorch

FP32

torch.compile

+

+

+

Object Detection

mask_rcnn_R_50_C4_1x

pytorch

FP32

torch.compile

+

Object Detection

mask_rcnn_R_50_DC5_1x

pytorch

FP32

torch.compile

+

Object Detection

mask_rcnn_R_50_FPN

pytorch

FP32

torch.compile

+

Object Detection

mask_rcnn_R_50_FPN_1x

pytorch

FP32

torch.compile

+

Object Detection

mask_rcnn_R_50_FPN_3x

pytorch

FP32

torch.compile

+

Object Detection

mask_rcnn_R_50_FPN_3x_dconv_c3-c5

pytorch

FP32

torch.compile

+

Object Detection

mask_rcnn_R_50_FPN_noaug_1x

pytorch

FP32

torch.compile

+

Object Detection

maskrcnn_resnet50_fpn

pytorch

FP32

torch.compile

+

+

+

Object Detection

maskrcnn_resnet50_fpn_v2

pytorch

FP32

torch.compile

+

+

+

Image Classification

maxvit_rmlp_small_rw_224.sw_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

maxvit_t

pytorch

FP32

torch.compile

+

+

+

Image Classification

maxxvit_rmlp_small_rw_256.sw_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

maxxvitv2_rmlp_base_rw_224.sw_in12k_ft_in1k

pytorch

FP32

torch.compile

+

+

+

Action Recognition

mc3_18

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

minilm-uncased-squad2

pytorch

FP32

torch.compile

+

+

+

Image Classification

mixer_b16_224_miil

pytorch

FP32

torch.compile

+

+

+

Image Classification

mixer_l16_224_in21k

pytorch

FP32

torch.compile

+

+

+

Image Classification

mnasnet0_5

pytorch

FP32

torch.compile

+

+

+

Image Classification

mnasnet0_75

pytorch

FP32

torch.compile

+

+

+

Image Classification

mnasnet1_0

pytorch

FP32

torch.compile

+

+

+

Image Classification

mnasnet1_3

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

mobilebert-uncased

pytorch

FP32

torch.compile

+

+

+

Object Detection

mobilenet_v2

pytorch

FP32

torch.compile

+

+

+

Object Detection

mobilenet_v3_large

pytorch

FP32

torch.compile

+

+

+

Object Detection

mobilenet_v3_small

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

mpnet-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

mt5-small-sum-de-en-v2

pytorch

FP32

torch.compile

+

+

+

Video Classification

mvit_v1_b

pytorch

FP32

torch.compile

+

+

+

Video Classification

mvit_v2_s

pytorch

FP32

torch.compile

+

+

+

Video Classification

mvitv2_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

nf_regnet_b1

pytorch

FP32

torch.compile

+

+

+

Image Classification

nf_resnet50

pytorch

FP32

torch.compile

+

+

+

Image Classification

nfnet_l0

pytorch

FP32

torch.compile

+

+

+

Recommender

nvidia_deeprecommender

pytorch

FP32

torch.compile

+

+

+

Panoptic Segmentation

panoptic_fpn_R_101_dconv_cascade_gn_3x

pytorch

FP32

torch.compile

+

Panoptic Segmentation

panoptic_fpn_R_50_1x

pytorch

FP32

torch.compile

+

Image Classification

phlippe_densenet

pytorch

FP32

torch.compile

+

+

+

Image Classification

phlippe_resnet

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

phobert-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

prot_bert

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

PubChem10M_SMILES_BPE_396_250

pytorch

FP32

torch.compile

+

+

+

Image Classification

pvt_v2_b3

pytorch

FP32

torch.compile

+

+

+

Ocean Simulator

pyhpc_equation_of_state

pytorch

FP32

torch.compile

+

+

+

Ocean Simulator

pyhpc_turbulent_kinetic_energy

pytorch

FP32

torch.compile

+

+

+

Image to Image

pytorch_CycleGAN_and_pix2pix

pytorch

FP32

torch.compile

+

+

+

Image to Image

pytorch_stargan

pytorch

FP32

torch.compile

+

+

+

Video Classification

r2plus1d_18

pytorch

FP32

torch.compile

+

+

+

Video Classification

r3d_18

pytorch

FP32

torch.compile

+

+

+

Movement Prediction

raft_large

pytorch

FP32

torch.compile

+

+

+

Movement Prediction

raft_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_1_6gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_16gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_3_2gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_32gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_400mf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_800mf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_x_8gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_1_6gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_128gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_16gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_3_2gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_32gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_400mf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_800mf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnet_y_8gf

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnetv_040

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnetx_032

pytorch

FP32

torch.compile

+

+

+

Image Classification

RegNetX_32GF_dds_8gpu

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnety_080

pytorch

FP32

torch.compile

+

+

+

Image Classification

regnetz_b16

pytorch

FP32

torch.compile

+

+

+

Image Classification

repvgg_b3

pytorch

FP32

torch.compile

+

+

+

Image Classification

repvgg_b3.rvgg_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

res2net50_26w_4s

pytorch

FP32

torch.compile

+

+

+

Image Classification

res2next50

pytorch

FP32

torch.compile

+

+

+

Image Classification

resmlp_12_224.fb_distilled_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

resmlp_12_distilled_224

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnest200e

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnest50d_4s2x40d

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnet101

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnet152

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnet18

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnet34

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnet50

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnet50d

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnetaa50

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnetrs200

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnext101_32x8d

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnext101_64x4d

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnext50_32x4d

pytorch

FP32

torch.compile

+

+

+

Object Detection

retinanet_resnet50_fpn

pytorch

FP32

torch.compile

+

+

+

Object Detection

retinanet_resnet50_fpn_v2

pytorch

FP32

torch.compile

+

+

+

Image Classification

rexnet_130

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

roberta-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

roberta-base-MRPC

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

roberta-large

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

roformer_chinese_base

pytorch

FP32

torch.compile

+

+

+

Video Classification

s3d

pytorch

FP32

torch.compile

+

+

+

Image Classification

sebotnet33ts_256

pytorch

FP32

torch.compile

+

+

+

Image Classification

sehalonet33ts

pytorch

FP32

torch.compile

+

+

+

Image Classification

selecsls42b

pytorch

FP32

torch.compile

+

+

+

Image Classification

sequencer2d_m

pytorch

FP32

torch.compile

+

+

+

Image Classification

seresnet50

pytorch

FP32

torch.compile

+

+

+

Image Classification

seresnext50_32x4d

pytorch

FP32

torch.compile

+

+

+

Image Classification

shufflenet_v2_x0_5

pytorch

FP32

torch.compile

+

+

+

Image Classification

shufflenet_v2_x1_0

pytorch

FP32

torch.compile

+

+

Image Classification

shufflenet_v2_x1_5

pytorch

FP32

torch.compile

+

+

+

Image Classification

shufflenet_v2_x2_0

pytorch

FP32

torch.compile

+

+

+

Image Classification

simmim_swin_transformer

pytorch

FP32

torch.compile

+

+

+

Image Classification

skresnet34

pytorch

FP32

torch.compile

+

+

+

Image Classification

skresnext50_32x4d

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

small-base

pytorch

FP32

torch.compile

+

+

Speech Recognition

speech_transformer

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

splinter-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

squeezebert-uncased

pytorch

FP32

torch.compile

+

+

+

Image Classification

squeezenet1_0

pytorch

FP32

torch.compile

+

+

Image Classification

squeezenet1_1

pytorch

FP32

torch.compile

+

+

Object Detection

ssd300_vgg16

pytorch

FP32

torch.compile

+

+

+

Object Detection

ssdlite320_mobilenet_v3_large

pytorch

FP32

torch.compile

+

+

+

Image Classification

ssl_resnext101_32x8d

pytorch

FP32

torch.compile

+

+

+

Object Detection

stacked_hourglass

pytorch

FP32

torch.compile

+

+

+

Video Processing

Super_SloMo

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_b

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_base_patch4_window7_224

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_s

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_t

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_tiny_patch4_window7_224

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_tiny_patch4_window7_224.ms_in1k

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_v2_b

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_v2_s

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin_v2_t

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin3d_b

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin3d_s

pytorch

FP32

torch.compile

+

+

+

Image Classification

swin3d_t

pytorch

FP32

torch.compile

+

+

+

Image Classification

swsl_resnet50

pytorch

FP32

torch.compile

+

+

+

Image Classification

swsl_resnext101_32x4d

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

t5-small

pytorch

FP32

torch.compile

+

+

+

Image Classification

tf_inception_v3

pytorch

FP32

torch.compile

+

+

+

Image Classification

nfnet

pytorch

FP32

torch.compile

+

+

Image Classification

regnet

pytorch

FP32

torch.compile

+

+

+

Image Classification

resnest

pytorch

FP32

torch.compile

+

+

+

Image Classification

vovnet

pytorch

FP32

torch.compile

+

+

Natural Language Processing

tiny_sd_text_encoder

pytorch

FP32

torch.compile

+

+

+

Image Generation

tiny_sd_unet

pytorch

FP32

torch.compile

+

+

+

Image Generation

tiny_sd_vae_encoder

pytorch

FP32

torch.compile

+

+

+

Text to Speech

tts_angular

pytorch

FP32

torch.compile

+

+

+

Image Classification

tv_densenet121

pytorch

FP32

torch.compile

+

+

+

Image Classification

tv_resnet50

pytorch

FP32

torch.compile

+

+

+

Image Classification

twins_pcpvt_base

pytorch

FP32

torch.compile

+

+

+

Image Classification

twins_pcpvt_large

pytorch

FP32

torch.compile

+

+

+

Image Classification

twins_pcpvt_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

twins_svt_base

pytorch

FP32

torch.compile

+

+

+

Image Classification

twins_svt_large

pytorch

FP32

torch.compile

+

+

+

Image Classification

twins_svt_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg11

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg11_bn

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg13

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg13_bn

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg16

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg16_bn

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg19

pytorch

FP32

torch.compile

+

+

+

Image Classification

vgg19_bn

pytorch

FP32

torch.compile

+

+

+

Image Classification

visformer_small

pytorch

FP32

torch.compile

+

+

+

Image Classification

vision_maskrcnn

pytorch

FP32

torch.compile

+

+

+

Image Classification

vit_b_16

pytorch

FP32

torch.compile

+

+

+

Image Classification

vit_b_32

pytorch

FP32

torch.compile

+

+

+

Image Classification

vit_h_14

pytorch

FP32

torch.compile

+

+

+

Image Classification

vit_l_16

pytorch

FP32

torch.compile

+

+

+

Image Classification

vit_l_32

pytorch

FP32

torch.compile

+

+

+

Image Classification

wide_resnet101_2

pytorch

FP32

torch.compile

+

+

+

Image Classification

wide_resnet50_2

pytorch

FP32

torch.compile

+

+

+

Image Classification

xception

pytorch

FP32

torch.compile

+

+

+

Image Classification

xception65

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

xlm-roberta-base

pytorch

FP32

torch.compile

+

+

+

Natural Language Processing

xlnet-base-cased

pytorch

FP32

torch.compile

+

+

Object Detection

yolo11

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5l

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5l6

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5m

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5m6

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5n

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5n6

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5s

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5s6

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5x

pytorch

FP32

torch.compile

+

+

+

Object Detection

yolov5x6

pytorch

FP32

torch.compile

+

+

+

Large Language Model

DLRM

onnx

FP32

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased

paddle

FP32

OpenVINO

+

+

+

Object Detection

centernet-hg104

tf2

FP32

OpenVINO

+

+

Object Detection

centernet-resnet

tf

FP32

OpenVINO

+

+

Audio

data2vec2-base

onnx

FP32

OpenVINO

+

+

+

Semantic Segmentation

deeplab-v3p-resnet50-os8

paddle

FP32

OpenVINO

+

+

Click-Through Rate (CTR) Prediction

dien

tf

FP32

OpenVINO

+

+

Image Processing, Enhancement

ebgan

tf

FP32

OpenVINO

+

+

Object Detection

facial-landmarks-98-detection-0001

onnx

FP32

OpenVINO

+

+

+

Image to Image

fast-neural-style-mosaic

onnx

FP32

OpenVINO

+

+

+

Audio

intel_dns

onnx

FP32

OpenVINO

+

+

+

Object Detection

mask-rcnn-resnet50-fpn

onnx

FP32

OpenVINO

+

Object Detection

mobilenet-v2

paddle

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v2-1.0-224

tf2

FP32

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

paddle

FP32

OpenVINO

+

+

+

Object Detection

pp-ocr-det

paddle

FP32

OpenVINO

+

+

+

Object Detection

pp-ocr-rec

paddle

FP32

OpenVINO

+

+

+

Object Detection

pp-yolo

paddle

FP32

OpenVINO

+

Image Classification

resnet-50

paddle

FP32

OpenVINO

+

+

+

Image Classification

resnet-v1.5-50

tf

FP32

OpenVINO

+

+

+

Image Classification

retinanet

tf

FP32

OpenVINO

+

Audio

rnnt_encoder

onnx

FP32

OpenVINO

+

+

Audio

rnnt_joint

onnx

FP32

OpenVINO

+

+

+

Audio

rnnt_prediction

onnx

FP32

OpenVINO

+

+

+

Image Classification

squeezenet1.1

tf

FP32

OpenVINO

+

+

+

Object Detection

ssdlite-mobilenet-v3-small-320-coco

paddle

FP32

OpenVINO

+

+

Image Generation

stable-diffusion-v1-4-text-encoder

onnx

FP32

OpenVINO

+

+

+

Image Generation

stable-diffusion-v1-4-unet

onnx

FP32

OpenVINO

+

+

Image Generation

stable-diffusion-v1-4-vae-decoder

onnx

FP32

OpenVINO

+

+

+

Image Generation

stable-diffusion-v1-4-vae-encoder

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo-v3

tf

FP32

OpenVINO

+

+

+

Object Detection

yolo_v3_tiny

onnx

FP32

OpenVINO

+

+

+

Object Detection

yolo_v3_tiny

tf

FP32

OpenVINO

+

+

+

Object Detection

centernet-hg104

tf2

FP16

OpenVINO

+

+

Object Detection

centernet-resnet

tf

FP16

OpenVINO

+

+

Audio

data2vec2-base

onnx

FP16

OpenVINO

+

+

+

Semantic Segmentation

deeplab-v3p-resnet50-os8

paddle

FP16

OpenVINO

+

+

Click-Through Rate (CTR) Prediction

dien

tf

FP16

OpenVINO

+

+

Image Processing, Enhancement

ebgan

tf

FP16

OpenVINO

+

+

Object Detection

facial-landmarks-98-detection-0001

onnx

FP16

OpenVINO

+

+

+

Image to Image

fast-neural-style-mosaic

onnx

FP16

OpenVINO

+

+

+

Audio

intel_dns

onnx

FP16

OpenVINO

+

+

+

Object Detection

mask-rcnn-resnet50-fpn

onnx

FP16

OpenVINO

+

Object Detection

mobilenet-v2

paddle

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v2-1.0-224

tf2

FP16

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

paddle

FP16

OpenVINO

+

+

+

Object Detection

pp-ocr-det

paddle

FP16

OpenVINO

+

+

+

Object Detection

pp-ocr-rec

paddle

FP16

OpenVINO

+

+

+

Object Detection

pp-yolo

paddle

FP16

OpenVINO

+

Image Classification

resnet-50

paddle

FP16

OpenVINO

+

+

+

Image Classification

resnet-v1.5-50

tf

FP16

OpenVINO

+

+

+

Image Classification

retinanet

tf

FP16

OpenVINO

+

Audio

rnnt_encoder

onnx

FP16

OpenVINO

+

+

Audio

rnnt_joint

onnx

FP16

OpenVINO

+

+

+

Audio

rnnt_prediction

onnx

FP16

OpenVINO

+

+

+

Image Classification

squeezenet1.1

tf

FP16

OpenVINO

+

+

+

Object Detection

ssdlite-mobilenet-v3-small-320-coco

paddle

FP16

OpenVINO

+

+

Image Generation

stable-diffusion-v1-4-text-encoder

onnx

FP16

OpenVINO

+

+

+

Image Generation

stable-diffusion-v1-4-unet

onnx

FP16

OpenVINO

+

+

Image Generation

stable-diffusion-v1-4-vae-decoder

onnx

FP16

OpenVINO

+

+

+

Image Generation

stable-diffusion-v1-4-vae-encoder

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo-v3

tf

FP16

OpenVINO

+

+

+

Object Detection

yolo_v3_tiny

onnx

FP16

OpenVINO

+

+

+

Object Detection

yolo_v3_tiny

tf

FP16

OpenVINO

+

+

+

Natural Language Processing

bert-base-cased

paddle

INT8

OpenVINO

+

+

+

Semantic Segmentation

deeplab-v3p-resnet50-os8

paddle

INT8

OpenVINO

+

+

Image to Image

fast-neural-style-mosaic

onnx

INT8

OpenVINO

+

+

+

Audio

intel_dns

onnx

INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v2

paddle

INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v2-1.0-224

tf2

INT8

OpenVINO

+

+

+

Object Detection

mobilenet-v3-large-1.0-224

paddle

INT8

OpenVINO

+

+

+

Object Detection

pp-ocr-det

paddle

INT8

OpenVINO

+

+

+

Object Detection

pp-ocr-rec

paddle

INT8

OpenVINO

+

+

+

Object Detection

pp-yolo

paddle

INT8

OpenVINO

+

Image Classification

resnet-50

paddle

INT8

OpenVINO

+

+

+

Image Classification

resnet-v1.5-50

tf

INT8

OpenVINO

+

+

+

Image Classification

retinanet

tf

INT8

OpenVINO

+

+

Image Classification

squeezenet1.1

tf

INT8

OpenVINO

+

+

+

Object Detection

yolo_v3_tiny

onnx

INT8

OpenVINO

+

+

+

Object Detection

yolo_v3_tiny

tf

INT8

OpenVINO

+

+

+

Large Language Model

MarianCausalLM

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Pegasus-7b-slerp

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Aquila-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Aquila2-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

AquilaChat-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

AquilaChat2-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

GPT2Neo1.3BPoints

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-1.4b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-12b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-14m

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-160m

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-1b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-2.8b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-410m

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-6.9b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

pythia-70m

pytorch

INT4

Optimum Intel

+

+

Large Language Model

zephyr-7b-beta

pytorch

INT4

Optimum Intel

+

+

Large Language Model

neural-chat-7b-v1-1

pytorch

INT4

Optimum Intel

+

+

Large Language Model

neural-chat-7b-v3-3

pytorch

INT4

Optimum Intel

+

+

Large Language Model

CodeQwen1.5-7B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-0.5B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-0.5B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-1.8B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-1.8B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-4B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-4B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Qwen1.5-7B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegen-2B-multi

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegen-350M-mono

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegen2-1B_P

pytorch

INT4

Optimum Intel

+

+

Large Language Model

WizardMath-7B-V1.1

pytorch

INT4

Optimum Intel

+

+

Large Language Model

MindChat-Qwen2-4B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

persimmon-8b-chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Baichuan2-7B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

bloom-560m

pytorch

INT4

Optimum Intel

+

+

Large Language Model

bloomz-1b1

pytorch

INT4

Optimum Intel

+

+

Large Language Model

bloomz-3b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

bloomz-7b1-mt

pytorch

INT4

Optimum Intel

+

+

Large Language Model

opt-1.3b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

opt-2.7b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegemma-1.1-2b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegemma-1.1-7b-it

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegemma-2b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

codegemma-7b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gemma-1.1-2b-it

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gemma-1.1-7b-it

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gemma-2b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gemma-2b-it

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gemma-7b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gemma-7b-it

pytorch

INT4

Optimum Intel

+

+

Large Language Model

granite-3b-code-base

pytorch

INT4

Optimum Intel

+

+

Large Language Model

granite-3b-code-instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

internlm2-1_8b

pytorch

INT4

Optimum Intel

+

Large Language Model

internlm2-7b

pytorch

INT4

Optimum Intel

+

Large Language Model

internlm2-chat-1_8b

pytorch

INT4

Optimum Intel

+

Large Language Model

internlm2-chat-7b

pytorch

INT4

Optimum Intel

+

Large Language Model

internlm2-chat-7b-sft

pytorch

INT4

Optimum Intel

+

Large Language Model

internlm2-math-7b

pytorch

INT4

Optimum Intel

+

Large Language Model

internlm2-math-base-7b

pytorch

INT4

Optimum Intel

+

Large Language Model

Magicoder-CL-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Magicoder-DS-6.7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Magicoder-S-CL-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Magicoder-S-DS-6.7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Llama-2-13b-chat-hf

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Llama-2-13b-hf

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Llama-2-7b-chat-hf

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Llama-2-7b-hf

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Meta-Llama-3-8B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Meta-Llama-3-8B-Instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Meta-Llama-Guard-2-8B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Phi-3-medium-4k-instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Phi-3-mini-128k-instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

phi-2

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Mistral-7B-Instruct-v0.2

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Mistral-7B-Instruct-v0.3

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Mistral-7B-v0.3

pytorch

INT4

Optimum Intel

+

+

Large Language Model

mpt-7b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

mpt-7b-8k

pytorch

INT4

Optimum Intel

+

+

Large Language Model

mpt-7b-8k-chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

mpt-7b-chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

mpt-7b-instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

mpt-7b-storywriter

pytorch

INT4

Optimum Intel

+

+

Large Language Model

gpt2

pytorch

INT4

Optimum Intel

+

+

Large Language Model

MiniCPM-2B-sft-bf16

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-2-12b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-2-12b-chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-2-1_6b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-2-1_6b-chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-2-zephyr-1_6b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-3b-4e1t

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-base-alpha-3b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-tuned-alpha-7b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

stablelm-zephyr-3b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

BioMedLM

pytorch

INT4

Optimum Intel

+

+

Large Language Model

falcon-11B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

falcon-7b

pytorch

INT4

Optimum Intel

+

+

Large Language Model

falcon-7b-instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

Pythia-Chat-Base-7B

pytorch

INT4

Optimum Intel

+

+

Large Language Model

RedPajama-INCITE-7B-Base

pytorch

INT4

Optimum Intel

+

+

Large Language Model

RedPajama-INCITE-7B-Chat

pytorch

INT4

Optimum Intel

+

+

Large Language Model

RedPajama-INCITE-7B-Instruct

pytorch

INT4

Optimum Intel

+

+

Large Language Model

RedPajama-INCITE-Chat-3B-v1

pytorch

INT4

Optimum Intel

+

+

Audio Classification

ast-finetuned-speech-commands-v2

pytorch

intel-optimum default

Optimum Intel

+

+

Audio Classification

wav2vec2-base-superb-sid

pytorch

intel-optimum default

Optimum Intel

+

+

Audio Classification

wav2vec2-base-superb-sd

pytorch

intel-optimum default

Optimum Intel

+

+

Audio Classification

unispeech-sat-base-plus-sd

pytorch

intel-optimum default

Optimum Intel

+

+

Audio

wav2vec2-base-superb-sv

pytorch

intel-optimum default

Optimum Intel

+

+

Audio

unispeech-sat-base-sv

pytorch

intel-optimum default

Optimum Intel

+

+

Audio

unispeech-sat-large-sv

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bge-large-en-v1.5

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

BERT-Large-CT-STSb

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-base-cased-conversational

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

Polish_RoBERTa_large_OPI

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

sup-simcse-roberta-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

distilbert-base-nli-mean-tokens

pytorch

intel-optimum default

Optimum Intel

+

+

Image Classification

mobilevit-xx-small

pytorch

intel-optimum default

Optimum Intel

+

+

Image Classification

convnext-base-224

pytorch

intel-optimum default

Optimum Intel

+

+

Image Classification

levit-256

pytorch

intel-optimum default

Optimum Intel

+

+

Object Detection

mobilenet_v1_1.0_224

pytorch

intel-optimum default

Optimum Intel

+

+

Object Detection

mobilenet_v2_1.4_224

pytorch

intel-optimum default

Optimum Intel

+

+

Image Classification

vit-base-patch16-224

pytorch

intel-optimum default

Optimum Intel

+

+

Image Classification

beit-base-patch16-224-pt22k-ft22k

pytorch

intel-optimum default

Optimum Intel

+

+

Image Classification

resnet-18

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

roberta-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

roberta-large

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

xlm-roberta-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

xlm-roberta-large

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

albert-base-v2

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

albert-large-v2

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

electra-base-french-europeana-cased-generator

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

distilbert-base-uncased

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-base-uncased

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-large-uncased

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

roformer_small_generator

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

ibert-roberta-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

deberta-v3-large

pytorch

intel-optimum default

Optimum Intel

+

+

Image Generation

pix2struct-base

pytorch

intel-optimum default

Optimum Intel

+

+

Large Language Model

roberta-large-squadv2

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-base-cased-squad2

pytorch

intel-optimum default

Optimum Intel

+

+

Large Language Model

roberta-base-squad2

pytorch

intel-optimum default

Optimum Intel

+

+

Large Language Model

distilbert-base-uncased-distilled-squad

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-finetuned-squad

pytorch

intel-optimum default

Optimum Intel

+

+

Large Language Model

bert-small-finetuned-squadv2

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

blenderbot-400M-distill

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

m2m100_418M

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

mbart-large-50-many-to-one-mmt

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

t5-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

mt5-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bart-base-japanese

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

pegasus-samsum

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

marian-finetuned-kde4-en-to-cn-accelerate

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

albert-base-v2-sst2

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bge-reranker-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bge-reranker-large

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

electra-large-discriminator-nli-efl-tweeteval

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

xlm-roberta-large-en-ru-mnli

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

roberta-large-mnli

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

ibert-roberta-base-finetuned-mrpc

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

albert-large-v2-finetuned-mnli

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

twitter-roberta-base-sentiment-latest

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

ms-marco-electra-base

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

distilbert-base-uncased-finetuned-sst-2-english

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-large-uncased-whole-word-masking-finetuned-sst-2

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

convbert-base-turkish-mc4-toxicity-uncased

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

xlm-roberta-base-language-detection

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-base-uncased-yelp-polarity

pytorch

intel-optimum default

Optimum Intel

+

+

Speech Recognition

distil-large-v3

pytorch

intel-optimum default

Optimum Intel

+

+

Speech Recognition

distil-medium.en

pytorch

intel-optimum default

Optimum Intel

+

+

Speech Recognition

whisper-base

pytorch

intel-optimum default

Optimum Intel

+

+

Speech Recognition

whisper-large-v2

pytorch

intel-optimum default

Optimum Intel

+

+

Speech Recognition

whisper-medium

pytorch

intel-optimum default

Optimum Intel

+

+

Speech Recognition

whisper-small

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

xlm-roberta-large-finetuned-conll03-english

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

roberta-large-ner-english

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-base-NER

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

bert-large-NER

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

distilbert-NER

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

xlm-roberta-base-uncased-conll2003

pytorch

intel-optimum default

Optimum Intel

+

+

Natural Language Processing

klue-roberta-base-ner

pytorch

intel-optimum default

Optimum Intel

+

+

Image to Text

trocr-base-handwritten

pytorch

intel-optimum default

Optimum Intel

+

+

Marked cells indicate models that passed inference with no errors.

In the precision column, the “optimum-intel default” label corresponds to FP32 for small models and INT8 for models greater than 1B parameters.
The results as of September 3 2025, for OpenVINO version 2025.3.
The models come from different public model repositories, such as Pytorch Model Zoo and HuggingFace; they were executed on the designated hardware with OpenVINO either natively or as a backend.