AI Models verified for OpenVINO™ - ONNX only

The following is a list of ONNX models that have been verified to work with OpenVINO. Note that other models may also work properly but have not been tested.

AI Models that run on Intel® Core Ultra™ Processors with OpenVINO™ toolkit:

Model	Category	Framework	Precision	AI PC CPU	AI PC GPU	AI PC NPU
GPT-2	Large Language Model	onnx	FP16	+	+	+
GPT-2	Large Language Model	onnx	FP32	+		+
aclnet	Sound Classification	onnx	FP16	+	+	+
aclnet	Sound Classification	onnx	FP16-INT8	+		+
aclnet	Sound Classification	onnx	FP32		+	+
aclnet-int8	Sound Classification	onnx	FP16-INT8			+
albert-base-v2	Transformer	onnx	FP16	+	+
alexnet	Image Classification	onnx	FP32	+
alexnet	Image Classification	onnx	FP16		+	+
anti-spoof-mn3	Object Detection	onnx	FP16	+	+
asl-recognition-0003	Image Classification	onnx	FP16	+	+
asl-recognition-0003	Image Classification	onnx	FP16-INT8	+	+
asl-recognition-0003	Image Classification	onnx	FP32		+
asl-recognition-0004	Image Classification	onnx	FP16	+	+
began	Image Processing, Enhancement	onnx	FP16	+	+	+
began	Image Processing, Enhancement	onnx	FP32		+	+
bert-base-cased	Natural Language Processing	onnx	FP16	+	+
bert-base-cased	Natural Language Processing	onnx	FP16-INT8	+		+
bert-base-cased	Natural Language Processing	onnx	FP32		+
bert-base-cased-squad2	Natural Language Processing	onnx	FP32	+	+
bert-base-cased-squad2	Natural Language Processing	onnx	FP16		+	+
bert-base-ner	Natural Language Processing	onnx	FP16	+	+
bert-base-ner	Natural Language Processing	onnx	FP32	+	+
bert-base-ner	Natural Language Processing	onnx	FP16-INT8		+	+
bert-base-uncased-mrpc	Natural Language Processing	onnx	FP16-INT8	+	+
bert-base-uncased-mrpc	Natural Language Processing	onnx	FP32	+	+
bert-base-uncased-mrpc	Natural Language Processing	onnx	FP16		+	+
bert-large-cased	Natural Language Processing	onnx	FP16-INT8	+
bert-large-cased	Natural Language Processing	onnx	FP32	+	+
bert-large-uncased-whole-word-masking-squad-0001	Natural Language Processing	onnx	FP16	+	+	+
bert-large-uncased-whole-word-masking-squad-0001	Natural Language Processing	onnx	FP32		+
bert-large-uncased-whole-word-masking-squad-emb-0001	Natural Language Processing	onnx	FP32	+
bert-large-uncased-whole-word-masking-squad-int8-0001	Natural Language Processing	onnx	FP16-INT8	+		+
bert-small-uncased-whole-word-masking-squad-0001	Natural Language Processing	onnx	FP32	+	+	+
bert-small-uncased-whole-word-masking-squad-0002	Natural Language Processing	onnx	FP16	+	+	+
bert-small-uncased-whole-word-masking-squad-0002	Natural Language Processing	onnx	FP32	+		+
bert-small-uncased-whole-word-masking-squad-emb-int8-0001	Natural Language Processing	onnx	FP16-INT8	+		+
bert-small-uncased-whole-word-masking-squad-int8-0002	Natural Language Processing	onnx	FP16-INT8		+	+
brain-tumor-segmentation-0002	Image Classification	onnx	FP16	+
brain-tumor-segmentation-0002	Image Classification	onnx	FP16-INT8	+
clip-vit-b-16-plus-240-laion400m-e32	dual use	onnx	FP16	+
clip-vit-b-16-plus-240-laion400m-e32	dual use	onnx	FP32	+
colorization-siggraph	Colorization	onnx	FP16	+	+	+
colorization-siggraph	Colorization	onnx	FP32		+	+
colorization-v2	Colorization	onnx	FP16-INT8	+	+
common-sign-language-0001	Image Classification	onnx	FP16	+		+
common-sign-language-0001	Image Classification	onnx	FP32	+	+	+
common-sign-language-0002	Image Classification	onnx	FP16	+	+	+
common-sign-language-0002	Image Classification	onnx	FP16-INT8	+
common-sign-language-0002	Image Classification	onnx	FP32	+	+
convnext-tiny	Vision Transformer	onnx	FP16	+
convnext-tiny	Vision Transformer	onnx	FP32	+
corel_nnart_001		onnx	FP16-INT8	+
ctdet_coco_dlav0_512	Object Detection	onnx	FP16	+		+
ctdet_coco_dlav0_512	Object Detection	onnx	FP16-INT8	+
ctdet_coco_dlav0_512	Object Detection	onnx	FP32			+
deblurgan-v2	Image Motion Deblurring	onnx	FP16	+	+
deblurgan-v2	Image Motion Deblurring	onnx	FP32	+	+
deeplabv3-mobilenetv3	Semantic Image Segmentation	onnx	FP16-INT8	+	+	+
deeplabv3-mobilenetv3	Semantic Image Segmentation	onnx	FP16		+
deeplabv3-mobilenetv3	Semantic Image Segmentation	onnx	FP32		+
deit-b	Image Classification Transformer	onnx	FP16		+
densenet-121	Image Classification	onnx	FP16	+	+	+
densenet-121	Image Classification	onnx	FP32		+
densenet-161	Image Classification	onnx	FP16	+		+
densenet-161	Image Classification	onnx	FP16-INT8	+		+
detr_resnet50	Object Detection	onnx	FP16	+
detr_resnet50	Object Detection	onnx	FP32	+	+
distilbert-base-cased	Natural Language Processing	onnx	FP16	+	+	+
distilbert-base-cased	Natural Language Processing	onnx	FP32		+
distilbert-base-uncased	Natural Language Processing	onnx	FP16	+		+
distilbert-base-uncased	Natural Language Processing	onnx	FP16-INT8	+		+
distilbert-base-uncased	Natural Language Processing	onnx	FP32	+
distilbert-base-uncased-sst-2	Natural Language Processing	onnx	FP16-INT8	+	+
distilbert-base-uncased-sst-2	Natural Language Processing	onnx	FP32	+	+	+
distilbert-base-uncased-sst-2	Natural Language Processing	onnx	FP16		+
dla-34	Image Classification	onnx	FP16	+		+
dla-34	Image Classification	onnx	FP16-INT8	+
dna_r9.4.1	DNA Classification	onnx	FP32	+
dna_r9.4.1@v3	DNA Classification	onnx	FP16	+
dna_r9.4.1@v3	DNA Classification	onnx	FP32	+
dna_r9.4.1_2d	DNA Classification	onnx	FP16	+
dna_r9.4.1_2d	DNA Classification	onnx	FP16-INT8	+
dna_r9.4.1_2d	DNA Classification	onnx	FP32	+
dpn-68	Image Classification, Dual Path Network	onnx	FP16	+		+
dpn-68	Image Classification, Dual Path Network	onnx	FP16-INT8	+
dpn-68	Image Classification, Dual Path Network	onnx	FP32	+	+	+
drn-d-38	Semantic Image Segmentation	onnx	FP16	+
ebgan	Image Processing, Enhancement	onnx	FP16	+	+	+
ebgan	Image Processing, Enhancement	onnx	FP32		+	+
edsr3-nas	Image Processing, Enhancement	onnx	FP32	+	+	+
edsr3-nas	Image Processing, Enhancement	onnx	FP16			+
efficientnet-b0	Object Detection	onnx	FP16	+	+	+
efficientnet-b0	Object Detection	onnx	FP32	+
efficientnet-b0	Object Detection	onnx	FP16-INT8		+	+
efficientnet-v2-m	Object Detection	onnx	FP16	+	+	+
efficientnet-v2-m	Object Detection	onnx	FP16-INT8	+
efficientnet-v2-m	Object Detection	onnx	FP32	+	+	+
esrgan	Image Processing, Enhancement	onnx	FP32	+	+
esrgan	Image Processing, Enhancement	onnx	FP16			+
f3net	Object Detection	onnx	FP32	+	+	+
f3net	Object Detection	onnx	FP16		+	+
f3net	Object Detection	onnx	FP16-INT8		+
face-detection-0200	Object Detection	onnx	FP16			+
face-detection-0202	Object Detection	onnx	FP16	+
face-detection-0202	Object Detection	onnx	FP32	+	+	+
face-detection-0204	Object Detection	onnx	FP16	+	+	+
face-detection-0205	Object Detection	onnx	FP16	+
face-detection-0205	Object Detection	onnx	FP32	+
face-detection-0206	Object Detection	onnx	FP16	+
face-detection-0206	Object Detection	onnx	FP16-INT8	+
face-detection-retail-0005	Object Detection	onnx	FP16	+	+	+
face-detection-retail-0005	Object Detection	onnx	FP16-INT8	+	+
face-detection-retail-0005	Object Detection	onnx	FP32	+	+
face-recognition-resnet100-arcface	Object Detection	onnx	FP16	+	+
face-recognition-resnet100-arcface	Object Detection	onnx	FP16-INT8	+	+
face-reidentification-retail-0095	Object Detection	onnx	FP16-INT8	+	+	+
face-reidentification-retail-0095	Object Detection	onnx	FP16		+	+
faceboxes	Object Detection	onnx	FP16-INT8	+	+
faceboxes	Object Detection	onnx	FP32	+	+	+
faceboxes	Object Detection	onnx	FP16		+
facenet	Object Detection	onnx	FP16	+	+
facenet	Object Detection	onnx	FP16-INT8	+		+
facenet	Object Detection	onnx	FP32		+
facial-landmarks-98-detection-0001	Object Detection	onnx	FP16	+	+	+
facial-landmarks-98-detection-0001	Object Detection	onnx	FP32	+	+	+
faster_rcnn_resnet50_fpn_coco	Object Detection	onnx	FP16	+
faster_rcnn_resnet50_fpn_coco	Object Detection	onnx	FP16-INT8	+
faster_rcnn_resnet50_fpn_coco	Object Detection	onnx	FP32	+
fastseg-large	Semantic Segmentation	onnx	FP16	+	+
fastseg-large	Semantic Segmentation	onnx	FP32	+	+
fastseg-small	Semantic Segmentation	onnx	FP16	+	+
fastseg-small	Semantic Segmentation	onnx	FP16-INT8	+	+
fastseg-small	Semantic Segmentation	onnx	FP32	+
fbcnn	Image Processing, Enhancement	onnx	FP16-INT8	+
fbcnn	Image Processing, Enhancement	onnx	FP32		+
fbnetc-100	Image Classification	onnx	FP16-INT8	+	+	+
fbnetc-100	Image Classification	onnx	FP32	+	+	+
fbnetc-100	Image Classification	onnx	FP16			+
forward-tacotron-duration-prediction	Text-to-Speech	onnx	FP16	+
forward-tacotron-duration-prediction	Text-to-Speech	onnx	FP32	+		+
forward-tacotron-regression	Text-to-Speech	onnx	FP16	+
forward-tacotron-regression	Text-to-Speech	onnx	FP16-INT8	+
gaze-estimation-adas-0002	Object Detection	onnx	FP16	+	+	+
googlenet-v3	Image Classification	onnx	FP16	+	+	+
googlenet-v3	Image Classification	onnx	FP16-INT8	+	+	+
gpt2-wikitext2-int8-onnx-0001	Large Language Model	onnx	FP16-INT8		+
handwritten-english-recognition-0001	Text Detection	onnx	FP16	+
handwritten-english-recognition-0001	Text Detection	onnx	FP32	+
handwritten-japanese-recognition-0001	Text Detection	onnx	FP16-INT8	+
handwritten-simplified-chinese-recognition-0001	Text Detection	onnx	FP16	+		+
handwritten-simplified-chinese-recognition-0001	Text Detection	onnx	FP32	+	+	+
hbonet-0.25	Image Classification	onnx	FP16	+
hbonet-0.25	Image Classification	onnx	FP32	+	+
hbonet-0.5	Image Classification	onnx	FP16	+	+
hbonet-0.5	Image Classification	onnx	FP16-INT8	+	+	+
hbonet-0.5	Image Classification	onnx	FP32	+	+
hbonet-1.0	Image Classification	onnx	FP16	+	+
hbonet-1.0	Image Classification	onnx	FP16-INT8	+	+
hg-s8-b1-mpii	Object Detection	onnx	FP16-INT8	+	+	+
hg-s8-b1-mpii	Object Detection	onnx	FP16		+	+
higher-hrnet-w32-512	Object Detection	onnx	FP16	+	+
higher-hrnet-w32-512	Object Detection	onnx	FP32	+	+
horizontal-text-detection-0001	Text Detection	onnx	FP16	+	+
horizontal-text-detection-0001	Text Detection	onnx	FP16-INT8	+
horizontal-text-detection-0001	Text Detection	onnx	FP32	+	+
hrnet-v2-c1-segmentation	Semantic Segmentation	onnx	FP16-INT8	+		+
human-pose-estimation-0002	Object Detection	onnx	FP16	+
human-pose-estimation-0002	Object Detection	onnx	FP32	+	+
human-pose-estimation-0003	Object Detection	onnx	FP16	+
human-pose-estimation-0003	Object Detection	onnx	FP32	+
human-pose-estimation-0004	Object Detection	onnx	FP16	+
human-pose-estimation-0005	Object Detection	onnx	FP32	+
human-pose-estimation-0006	Object Detection	onnx	FP16	+
human-pose-estimation-0007	Object Detection	onnx	FP16	+
human-pose-estimation-3d-0001	Object Detection	onnx	FP32	+
human-pose-estimation-3d-0001	Object Detection	onnx	FP16		+
inceptionv3-int8-onnx-0001	Image Classification	onnx	FP16-INT8	+
instance-segmentation-person-0007	Instance Segmentation	onnx	FP32	+
instance-segmentation-security-0002	Instance Segmentation	onnx	FP16	+
instance-segmentation-security-0010	Instance Segmentation	onnx	FP32	+
instance-segmentation-security-0050	Instance Segmentation	onnx	FP16	+
instance-segmentation-security-0050	Instance Segmentation	onnx	FP32	+
instance-segmentation-security-0228	Instance Segmentation	onnx	FP16	+
instance-segmentation-security-1025	Instance Segmentation	onnx	FP32	+
instance-segmentation-security-1039	Instance Segmentation	onnx	FP16	+
iseebetter	Video Super-Resolution	onnx	FP16	+
iseebetter	Video Super-Resolution	onnx	FP32	+	+
landmarks-regression-retail-0009	Object Detection	onnx	FP16-INT8	+
levit-128s	Image Classification	onnx	FP16-INT8	+
lraspp-mobilenet-v3-large	Semantic Segmentation	onnx	FP16	+		+
lraspp-mobilenet-v3-large	Semantic Segmentation	onnx	FP16-INT8	+	+	+
lraspp-mobilenet-v3-large	Semantic Segmentation	onnx	FP32	+
machine-translation-nar-de-en-0001	Natural Language Processing	onnx	FP16	+
machine-translation-nar-de-en-0002	Natural Language Processing	onnx	FP16	+
machine-translation-nar-en-de-0001	Natural Language Processing	onnx	FP16	+
machine-translation-nar-en-de-0002	Natural Language Processing	onnx	FP16	+
machine-translation-nar-en-ru-0002	Natural Language Processing	onnx	FP16	+
machine-translation-nar-en-ru-0002	Natural Language Processing	onnx	FP32	+
machine-translation-nar-ru-en-0002	Natural Language Processing	onnx	FP16	+
machine-translation-nar-ru-en-0002	Natural Language Processing	onnx	FP16-INT8	+
midasnet	Monodepth	onnx	FP16	+	+	+
midasnet	Monodepth	onnx	FP16-INT8		+	+
mlp-mixer-b16-224-miil	Image Classification	onnx	FP16	+		+
mlp-mixer-b16-224-miil	Image Classification	onnx	FP16-INT8	+		+
mlp-mixer-b16-224-miil	Image Classification	onnx	FP32	+
mnasnet-0.5	Image Classification	onnx	FP16			+
mobilebert	Natural Language Processing	onnx	FP16-INT8	+	+
mobilenet-v2	Object Detection	onnx	FP16	+	+
mobilenet-v2	Object Detection	onnx	FP16-INT8	+	+	+
mobilenet-v2	Object Detection	onnx	FP32	+	+
mobilenet-v3-large-1.0-224	Object Detection	onnx	FP16	+	+
mobilenet-v3-large-1.0-224	Object Detection	onnx	FP16-INT8		+	+
mobilenet-v3-large-1.0-224	Object Detection	onnx	FP32		+	+
mobilenet-v3-small-1.0-224	Object Detection	onnx	FP16	+		+
mobilenet-v3-small-1.0-224	Object Detection	onnx	FP16-INT8	+		+
mobilenet-v3-small-1.0-224	Object Detection	onnx	FP32	+
mobilenetv2-int8-onnx-0001	Object Detection	onnx	FP16-INT8	+
modnet_photographic_portrait_matting	Background Matting	onnx	FP16	+
modnet_photographic_portrait_matting	Background Matting	onnx	FP32	+
modnet_webcam_portrait_matting	Background Matting	onnx	FP16-INT8	+
modnet_webcam_portrait_matting	Background Matting	onnx	FP32	+
nanodet-m-1.5x-416	Object Detection	onnx	FP16	+		+
nanodet-m-1.5x-416	Object Detection	onnx	FP32	+	+	+
nanodet-m-1.5x-416	Object Detection	onnx	FP16-INT8			+
nfnet-f0	Image Classification	onnx	FP16	+
nfnet-f0	Image Classification	onnx	FP16-INT8	+
nfnet-f0	Image Classification	onnx	FP32	+
open-closed-eye-0001	Image Classification	onnx	FP16-INT8	+	+	+
open-closed-eye-0001	Image Classification	onnx	FP16		+
open-closed-eye-0001	Image Classification	onnx	FP32			+
person-attributes-recognition-crossroad-0230	Object Detection	onnx	FP16	+		+
person-attributes-recognition-crossroad-0234	Object Detection	onnx	FP16	+
person-attributes-recognition-crossroad-0238	Object Detection	onnx	FP16	+
person-attributes-recognition-crossroad-0238	Object Detection	onnx	FP16-INT8	+	+	+
person-detection-0100	Object Detection	onnx	FP32	+
person-detection-0100	Object Detection	onnx	FP16		+	+
person-detection-0101	Object Detection	onnx	FP16	+	+
person-detection-0101	Object Detection	onnx	FP32		+
person-detection-0102	Object Detection	onnx	FP16	+	+
person-detection-0200	Object Detection	onnx	FP16	+	+	+
person-detection-0201	Object Detection	onnx	FP16	+
person-detection-0201	Object Detection	onnx	FP32		+	+
person-detection-0202	Object Detection	onnx	FP16	+	+	+
person-detection-0202	Object Detection	onnx	FP32	+	+	+
person-detection-0203	Object Detection	onnx	FP16	+	+
person-detection-0203	Object Detection	onnx	FP16-INT8	+	+
person-detection-0301	Object Detection	onnx	FP16	+
person-detection-0301	Object Detection	onnx	FP32	+
person-detection-0302	Object Detection	onnx	FP16	+
person-detection-0303	Object Detection	onnx	FP16	+
person-detection-asl-0001	Object Detection	onnx	FP32	+
person-reidentification-retail-0277	Object Detection	onnx	FP16		+	+
person-reidentification-retail-0286	Object Detection	onnx	FP16	+
person-reidentification-retail-0287	Object Detection	onnx	FP16-INT8			+
person-reidentification-retail-0288	Object Detection	onnx	FP16	+	+	+
person-reidentification-retail-0288	Object Detection	onnx	FP32	+	+
person-vehicle-bike-detection-2000	Object Detection	onnx	FP16	+		+
person-vehicle-bike-detection-2001	Object Detection	onnx	FP16	+		+
person-vehicle-bike-detection-2001	Object Detection	onnx	FP32			+
person-vehicle-bike-detection-2003	Object Detection	onnx	FP16	+
person-vehicle-bike-detection-2003	Object Detection	onnx	FP32	+
person-vehicle-bike-detection-2004	Object Detection	onnx	FP16	+
person-vehicle-bike-detection-2004	Object Detection	onnx	FP32	+
product-detection-0001	Object Detection	onnx	FP32	+		+
product-detection-0001	Object Detection	onnx	FP16		+	+
product-detection-0001	Object Detection	onnx	FP16-INT8		+
pspnet-pytorch	Semantic Segmentation	onnx	FP16	+
pspnet-pytorch	Semantic Segmentation	onnx	FP16-INT8	+	+	+
quartznet-15x5-en	Speech Recognition	onnx	FP16	+
quartznet-15x5-en	Speech Recognition	onnx	FP16-INT8	+
quartznet-15x5-en	Speech Recognition	onnx	FP32	+
rcan	Image Processing, Enhancement	onnx	FP32	+	+
regnetx-3.2gf	Image Classification	onnx	FP16-INT8	+
regnetx-3.2gf	Image Classification	onnx	FP32	+		+
regnetx-3.2gf	Image Classification	onnx	FP16			+
repvgg-a0	Image Classification	onnx	FP16	+		+
repvgg-a0	Image Classification	onnx	FP32			+
repvgg-b1	Image Classification	onnx	FP16	+		+
repvgg-b3	Image Classification	onnx	FP16			+
repvgg-b3	Image Classification	onnx	FP32			+
resmlp-12-distilled-224	Image Classification	onnx	FP32	+		+
resmlp-12-distilled-224	Image Classification	onnx	FP16-INT8			+
resnest-50-pytorch	Image Classification	onnx	FP16	+		+
resnest-50-pytorch	Image Classification	onnx	FP32	+		+
resnest-50-pytorch	Image Classification	onnx	FP16-INT8			+
resnet-101	Image Classification	onnx	FP16	+		+
resnet-101	Image Classification	onnx	FP32	+		+
resnet-152	Image Classification	onnx	FP16	+		+
resnet-152	Image Classification	onnx	FP32	+		+
resnet-18	Image Classification	onnx	FP16	+		+
resnet-18	Image Classification	onnx	FP16-INT8	+	+	+
resnet-34-pytorch	Image Classification	onnx	FP16	+		+
resnet-34-pytorch	Image Classification	onnx	FP32	+		+
resnet-50	Image Classification	onnx	FP16-INT8	+	+	+
resnet-50	Image Classification	onnx	FP32	+
resnet-50	Image Classification	onnx	FP16			+
resnet-50-pytorch	Image Classification	onnx	FP16	+	+
resnet-50-pytorch	Image Classification	onnx	FP16-INT8	+	+	+
resnet-50-pytorch	Image Classification	onnx	FP32	+	+	+
resnet18-xnor-binary-onnx-0001	Image Classification	onnx	FP16-INT1	+
resnet50-int8-onnx-0001	Image Classification	onnx	FP16-INT8	+
resnext-101-32x8d	Image Classification	onnx	FP16	+	+
resnext-101-32x8d	Image Classification	onnx	FP32	+	+
resnext-50-32x4d	Image Classification	onnx	FP16	+		+
resnext-50-32x4d	Image Classification	onnx	FP16-INT8	+
resnext-50-32x4d	Image Classification	onnx	FP32	+		+
resnext101-32x16d-swsl	Image Classification	onnx	FP16	+	+	+
resnext101-32x16d-swsl	Image Classification	onnx	FP16-INT8	+
resnext101-32x16d-swsl	Image Classification	onnx	FP32	+	+	+
retinaface-resnet50	Image Classification	onnx	FP16-INT8	+	+	+
retinaface-resnet50	Image Classification	onnx	FP32	+	+
retinanet_resnet34	Image Classification	onnx	FP16-INT8	+		+
retinanet_resnet34	Image Classification	onnx	FP32	+	+
retinanet_resnet34	Image Classification	onnx	FP16		+	+
rexnet-v1-x1.0	Image Classification	onnx	FP32	+
rnnt	Speech Recognition	onnx	FP16	+
roberta-base	Natural Language Processing	onnx	FP16	+	+
roberta-base	Natural Language Processing	onnx	FP16-INT8	+	+	+
roberta-base	Natural Language Processing	onnx	FP32	+	+	+
roberta-base-mrpc	Natural Language Processing	onnx	FP16-INT8			+
roberta-large	Natural Language Processing	onnx	FP16	+	+	+
roberta-large	Natural Language Processing	onnx	FP32	+	+
sbert-base-mean-tokens	Natural Language Processing	onnx	FP16	+	+	+
sbert-base-mean-tokens	Natural Language Processing	onnx	FP16-INT8	+	+	+
sbert-base-mean-tokens	Natural Language Processing	onnx	FP32	+	+	+
se-resnext-50	Image Classification	onnx	FP16	+	+	+
se-resnext-50	Image Classification	onnx	FP16-INT8	+
shufflenet	Image Classification	onnx	FP16-INT8	+
shufflenet	Image Classification	onnx	FP32	+
shufflenet-v2-x0.5	Image Classification	onnx	FP16	+		+
shufflenet-v2-x1.0	Image Classification	onnx	FP16-INT8	+	+	+
shufflenet-v2-x1.0	Image Classification	onnx	FP32	+	+
single-human-pose-estimation-0001	Object Detection	onnx	FP16		+
single-human-pose-estimation-0001	Object Detection	onnx	FP32		+
single-image-super-resolution-1032	Image Processing, Enhancement	onnx	FP16	+	+
single-image-super-resolution-1032	Image Processing, Enhancement	onnx	FP32	+	+
single-image-super-resolution-1033	Image Processing, Enhancement	onnx	FP16	+
smartlab-object-detection-0001	Object Detection	onnx	FP16	+	+	+
smartlab-object-detection-0001	Object Detection	onnx	FP32	+	+	+
smartlab-object-detection-0003	Object Detection	onnx	FP16	+	+	+
smartlab-object-detection-0003	Object Detection	onnx	FP32	+	+	+
spnasnet-100	Image Classification	onnx	FP32	+		+
spnasnet-100	Image Classification	onnx	FP16-INT8			+
squeezenet1.0	Image Classification	onnx	FP16	+		+
squeezenet1.0	Image Classification	onnx	FP16-INT8	+		+
squeezenet1.0	Image Classification	onnx	FP32	+		+
squeezenet1.1	Image Classification	onnx	FP16	+	+
squeezenet1.1	Image Classification	onnx	FP32	+	+
squeezenet1.1-pytorch1.2.0	Image Classification	onnx	FP16	+		+
squeezenet1.1-pytorch1.2.0	Image Classification	onnx	FP16-INT8	+
squeezenet1.1-pytorch1.2.0	Image Classification	onnx	FP32	+		+
srgan	Image Processing, Enhancement	onnx	FP16	+
ssd-resnet34-1200	Object Detection	onnx	FP16	+	+
ssd-resnet34-1200	Object Detection	onnx	FP16-INT8	+	+
ssd-resnet34-1200	Object Detection	onnx	FP32	+
ssd-vgg16	Object Detection	onnx	FP16	+	+
ssd-vgg16	Object Detection	onnx	FP32	+	+
ssd-vgg16	Object Detection	onnx	FP16-INT8		+	+
ssd300-int8-onnx-0001	Object Detection	onnx	FP16-INT8	+	+
ssd300-onnx-0001	Object Detection	onnx	FP16	+	+	+
ssd300-onnx-0001	Object Detection	onnx	FP16-INT8	+	+	+
style_transfer	Image Processing	onnx	FP32	+	+	+
style_transfer	Image Processing	onnx	FP16			+
style_transfer	Image Processing	onnx	FP16-INT8			+
swin-tiny-patch4-window7-224	Image Classification	onnx	FP16-INT8	+	+
swin-tiny-patch4-window7-224	Image Classification	onnx	FP32	+	+
t2t-vit-14	Image Classification	onnx	FP16	+
t2t-vit-7	Image Classification	onnx	FP16	+
t2t-vit-7	Image Classification	onnx	FP32	+
text-image-super-resolution-0001	Image Processing, Enhancement	onnx	FP16		+
text-image-super-resolution-0001	Image Processing, Enhancement	onnx	FP32		+
text-recognition-0013	Text Detection	onnx	FP16	+
text-recognition-0013	Text Detection	onnx	FP32	+	+
text-recognition-0014	Text Detection	onnx	FP16	+
text-recognition-0014	Text Detection	onnx	FP32	+	+
text-recognition-resnet-fc	Text Detection	onnx	FP16	+		+
text-recognition-resnet-fc	Text Detection	onnx	FP32	+
time-series-forecasting-electricity-0001	Time-Series	onnx	FP16	+		+
time-series-forecasting-electricity-0001	Time-Series	onnx	FP16-INT8			+
tiny_yolo_v2	Object Detection	onnx	FP16	+	+	+
tiny_yolo_v2	Object Detection	onnx	FP32		+
tinybert_6layer_768dim_cola	Natural Language Processing	onnx	FP16	+	+	+
tinybert_6layer_768dim_cola	Natural Language Processing	onnx	FP16-INT8	+
tinybert_6layer_768dim_cola	Natural Language Processing	onnx	FP32	+	+
ultra-lightweight-face-detection-rfb-320	Object Detection	onnx	FP16	+	+	+
ultra-lightweight-face-detection-slim-320	Object Detection	onnx	FP16			+
ultra-lightweight-face-detection-slim-320	Object Detection	onnx	FP16-INT8			+
unet-2d	Semantic Segmentation	onnx	FP16	+	+	+
unet-2d	Semantic Segmentation	onnx	FP32	+	+
unet-camvid-onnx-0001	Semantic Segmentation	onnx	FP16	+	+
unet-camvid-onnx-0001	Semantic Segmentation	onnx	FP16-INT8	+	+	+
unet-camvid-onnx-0001	Semantic Segmentation	onnx	FP32	+
unet3d_mlperf	Semantic Segmentation	onnx	FP16-INT8	+
unet3d_mlperf	Semantic Segmentation	onnx	FP16		+
unet3d_mlperf	Semantic Segmentation	onnx	FP32		+
vehicle-detection-0200	Object Detection	onnx	FP16	+		+
vehicle-detection-0200	Object Detection	onnx	FP32	+		+
vehicle-detection-0201	Object Detection	onnx	FP16	+		+
vehicle-detection-0201	Object Detection	onnx	FP32	+
vehicle-detection-0202	Object Detection	onnx	FP16	+		+
vehicle-detection-0202	Object Detection	onnx	FP32	+		+
vehicle-reid-0001	Object Detection	onnx	FP16	+	+	+
vfnet-resnet50-fpn-pytorch	Object Detection	onnx	FP16	+
vgg-16-bn	Image Classification	onnx	FP16	+		+
vgg-16-bn	Image Classification	onnx	FP16-INT8	+
vgg-16-bn	Image Classification	onnx	FP32			+
vgg16	Image Classification	onnx	FP16-INT8	+
vgg16	Image Classification	onnx	FP32	+		+
vgg16	Image Classification	onnx	FP16			+
vgg19	Image Classification	onnx	FP16	+
vgg19	Image Classification	onnx	FP32	+		+
vit-base-16-224	Vision Transformer	onnx	FP16	+
vit-base-16-224	Vision Transformer	onnx	FP32	+
vitstr-small-patch16-224	Text Detection	onnx	FP16	+		+
vitstr-small-patch16-224	Text Detection	onnx	FP32	+	+	+
wav2vec2-base	Speech Recognition	onnx	FP16-INT8	+
wav2vec2-base	Speech Recognition	onnx	FP32	+
wavernn-rnn	Text-to-Speech	onnx	FP16	+	+	+
wavernn-rnn	Text-to-Speech	onnx	FP32			+
wavernn-upsampler	Text-to-Speech	onnx	FP32	+	+	+
wavernn-upsampler	Text-to-Speech	onnx	FP16		+	+
wdsr-small-x4	Image Processing, Enhancement	onnx	FP16	+
wdsr-small-x4	Image Processing, Enhancement	onnx	FP16-INT8	+
wdsr-small-x4	Image Processing, Enhancement	onnx	FP32		+
weld-porosity-detection-0001	Image Classification	onnx	FP32	+
weld-porosity-detection-0001	Image Classification	onnx	FP16			+
weld-porosity-detection-0001	Image Classification	onnx	FP16-INT8		+	+
wide-resnet-50-v2	Image Classification	onnx	FP16	+	+	+
wide-resnet-50-v2	Image Classification	onnx	FP16-INT8	+	+	+
wide-resnet-50-v2	Image Classification	onnx	FP32	+		+
xlm-roberta-base	Natural Language Processing	onnx	FP16	+	+	+
xlm-roberta-base	Natural Language Processing	onnx	FP32		+
xlnet	Transformer	onnx	FP16	+	+
xlnet	Transformer	onnx	FP16-INT8	+
xlnet	Transformer	onnx	FP32	+
yolact-resnet50-fpn-pytorch	Object Detection	onnx	FP16	+		+
yolact-resnet50-fpn-pytorch	Object Detection	onnx	FP32	+		+
yolo_v2	Object Detection	onnx	FP16	+		+
yolo_v2	Object Detection	onnx	FP32	+	+
yolo_v3	Object Detection	onnx	FP16-INT8	+	+
yolo_v3	Object Detection	onnx	FP32	+
yolo_v3	Object Detection	onnx	FP16		+
yolo_v3_tiny	Object Detection	onnx	FP16-INT8	+	+
yolo_v5l	Object Detection	onnx	FP16	+	+	+
yolo_v5l	Object Detection	onnx	FP32	+	+	+
yolo_v5m	Object Detection	onnx	FP16	+
yolo_v5m	Object Detection	onnx	FP32	+	+
yolo_v5m	Object Detection	onnx	FP16-INT8		+	+
yolo_v5m-v6	Object Detection	onnx	FP16	+	+	+
yolo_v5m-v6	Object Detection	onnx	FP32	+	+	+
yolo_v5m-v6	Object Detection	onnx	FP16-INT8		+	+
yolo_v5m6-v6	Object Detection	onnx	FP16	+
yolo_v5m6-v6	Object Detection	onnx	FP32	+
yolo_v5s	Object Detection	onnx	FP16	+	+	+
yolo_v5s	Object Detection	onnx	FP32	+	+
yolo_v5s	Object Detection	onnx	FP16-INT8		+	+
yolo_v5s-v6	Object Detection	onnx	FP32	+	+
yolo_v5s-v6	Object Detection	onnx	FP16		+
yolo_v5s-v6	Object Detection	onnx	FP16-INT8			+
yolo_v5x	Object Detection	onnx	FP16	+	+
yolo_v5x	Object Detection	onnx	FP32			+
yolo_v8n	Object Detection	onnx	FP16	+	+	+
yolo_v8n	Object Detection	onnx	FP16-INT8	+	+	+
yolo_v8n	Object Detection	onnx	FP32	+	+
yolof	Object Detection	onnx	FP16	+
yolof	Object Detection	onnx	FP16-INT8	+
yolor_p6	Object Detection	onnx	FP16	+	+	+
yolor_p6	Object Detection	onnx	FP32	+
yolor_p6	Object Detection	onnx	FP16-INT8			+
yolox-tiny	Object Detection	onnx	FP16		+	+
yolox-tiny	Object Detection	onnx	FP16-INT8			+
yolox-tiny	Object Detection	onnx	FP32		+	+

Marked cells indicate models that passed inference with no errors. Empty cells indicate models that were not tested. No failing runs producing an error have been recorded.

In the precision column, the “optimum-intel default” label corresponds to FP32 for small models and INT8 for models greater than 1B parameters.

The results as of December 18 2024, for OpenVINO version 2024.6.

The models come from different public model repositories, such as Pytorch Model Zoo and HuggingFace; they were executed on the designated hardware with OpenVINO either natively or as a backend.