AI Models verified for OpenVINO™

The following is a list of models that have been verified to work with OpenVINO. Note that other models from OpenVINO-supported frameworks may also work properly but have not been tested.

AI Models that run on Intel® Core Ultra™ Processors with OpenVINO™ toolkit:

Model	Category	Framework	Precision	AI PC CPU	AI PC GPU	AI PC NPU
aclnet	Sound Classification	onnx	FP16
aclnet	Sound Classification	onnx	FP16-INT8
aclnet	Sound Classification	onnx	FP32
aclnet-int8	Sound Classification	onnx	FP16-INT8
adv_inception_v3	Image Classification	pytorch	FP32
albert-base-v2	Natural Language Processing	pytorch	intel-optimum default
albert-base-v2-sst2	Natural Language Processing	pytorch	intel-optimum default
albert-large-v2	Natural Language Processing	pytorch	intel-optimum default
albert-large-v2-finetuned-mnli	Natural Language Processing	pytorch	intel-optimum default
alexnet-caffe	Image Classification	caffe	FP16
alexnet-caffe	Image Classification	caffe	FP32
alexnet-onnx	Image Classification	onnx	FP16
alexnet-onnx	Image Classification	onnx	FP16-INT8
alexnet-onnx	Image Classification	onnx	FP32
Aquila2-7B	Large Language Model	pytorch	intel-optimum default
Aquila-7B	Large Language Model	pytorch	intel-optimum default
AquilaChat2-7B	Large Language Model	pytorch	intel-optimum default
AquilaChat-7B	Large Language Model	pytorch	intel-optimum default
arcfaceresnet100-8_resnet100	Object Detection	onnx	FP16
arcfaceresnet100-8_resnet100	Object Detection	onnx	FP32
ast-finetuned-speech-commands-v2	Audio Classification	pytorch	intel-optimum default
Baichuan2-13B-Chat	Large Language Model	pytorch	intel-optimum default
Baichuan2-7B-Base	Large Language Model	pytorch	intel-optimum default
Baichuan2-7B-Chat	Large Language Model	pytorch	intel-optimum default
bart-base-japanese	Natural Language Processing	pytorch	intel-optimum default
began	Image Processing, Enhancement	onnx	FP16
began	Image Processing, Enhancement	onnx	FP32
beit_base_patch16_224	Image Classification	pytorch	FP32
beit-base-patch16-224-pt22k-ft22k	Image Classification	pytorch	intel-optimum default
bert-base-cased-conversational	Natural Language Processing	pytorch	intel-optimum default
bert-base-cased-onnx	Natural Language Processing	onnx	FP16
bert-base-cased-onnx	Natural Language Processing	onnx	FP16-INT8
bert-base-cased-onnx	Natural Language Processing	onnx	FP32
bert-base-cased-paddle	Natural Language Processing	paddle	FP16
bert-base-cased-paddle	Natural Language Processing	paddle	FP16-INT8
bert-base-cased-paddle	Natural Language Processing	paddle	FP32
bert-base-cased-squad2	Natural Language Processing	onnx	FP16
bert-base-cased-squad2	Natural Language Processing	onnx	FP32
bert-base-chinese-xnli-zh	Natural Language Processing	tf	FP16
bert-base-chinese-xnli-zh	Natural Language Processing	tf	FP32
bert-base-ner	Natural Language Processing	onnx	FP16
bert-base-ner	Natural Language Processing	onnx	FP16-INT8
bert-base-ner	Natural Language Processing	onnx	FP32
bert-base-NER	Natural Language Processing	pytorch	intel-optimum default
bert-base-uncased	Natural Language Processing	pytorch	intel-optimum default
bert-base-uncased-mrpc	Natural Language Processing	onnx	FP16
bert-base-uncased-mrpc	Natural Language Processing	onnx	FP16-INT8
bert-base-uncased-mrpc	Natural Language Processing	onnx	FP32
bert-base-uncased-yelp-polarity	Natural Language Processing	pytorch	intel-optimum default
BERT-Large-CT-STSb	Natural Language Processing	pytorch	intel-optimum default
bert-large-NER	Natural Language Processing	pytorch	intel-optimum default
bert-large-uncased	Natural Language Processing	pytorch	intel-optimum default
bert-large-uncased-whole-word-masking-finetuned-sst-2	Natural Language Processing	pytorch	intel-optimum default
bert-large-uncased-whole-word-masking-squad-0001	Natural Language Processing	onnx	FP16
bert-large-uncased-whole-word-masking-squad-0001	Natural Language Processing	onnx	FP32
bert-large-uncased-whole-word-masking-squad-int8-0001	Natural Language Processing	onnx	FP16-INT8
bert-small-finetuned-squadv2	Large Language Model	pytorch	intel-optimum default
bertsquad-12	Natural Language Processing	onnx	FP16
bertsquad-12	Natural Language Processing	onnx	FP32
bge-base-en-v1.5	Natural Language Processing	pytorch	intel-optimum default
bge-large-en-v1.5	Natural Language Processing	pytorch	intel-optimum default
bge-reranker-base	Natural Language Processing	pytorch	intel-optimum default
bge-reranker-large	Natural Language Processing	pytorch	intel-optimum default
BioMedLM	Large Language Model	pytorch	intel-optimum default
bisenet-v2	Semantic Segmentation	paddle	FP16
bisenet-v2	Semantic Segmentation	paddle	FP32
blenderbot-400M-distill	Natural Language Processing	pytorch	intel-optimum default
bloom-560m	Large Language Model	pytorch	intel-optimum default
bloomz-1b1	Large Language Model	pytorch	intel-optimum default
bloomz-3b	Large Language Model	pytorch	intel-optimum default
bloomz-7b1-mt	Large Language Model	pytorch	intel-optimum default
botnet26t_256	Image Classification	pytorch	FP32
brain-tumor-segmentation-0002	Image Classification	onnx	FP16
brain-tumor-segmentation-0002	Image Classification	onnx	FP16-INT8
bvlcalexnet-12	Image Classification	onnx	FP16
bvlcalexnet-12	Image Classification	onnx	FP32
caffenet-12	Image Classification	onnx	FP16
caffenet-12	Image Classification	onnx	FP32
cait_m36_384	Image Classification	pytorch	FP32
candy-8_candy	Vision Style Transfer	onnx	FP16
candy-8_candy	Vision Style Transfer	onnx	FP32
coat_lite_mini	Image Classification	pytorch	FP32
codegemma-1.1-2b	Large Language Model	pytorch	intel-optimum default
codegemma-1.1-7b-it	Large Language Model	pytorch	intel-optimum default
codegemma-2b	Large Language Model	pytorch	intel-optimum default
codegemma-7b	Large Language Model	pytorch	intel-optimum default
codegen2-1B_P	Large Language Model	pytorch	intel-optimum default
codegen2-3_7B_P	Large Language Model	pytorch	intel-optimum default
codegen2-7B_P	Large Language Model	pytorch	intel-optimum default
codegen-2B-multi	Large Language Model	pytorch	intel-optimum default
codegen-350M-mono	Large Language Model	pytorch	intel-optimum default
codegen-6B-multi	Large Language Model	pytorch	intel-optimum default
CodeQwen1.5-7B-Chat	Large Language Model	pytorch	intel-optimum default
colorization-siggraph	Colorization	onnx	FP16
colorization-siggraph	Colorization	onnx	FP16
colorization-siggraph	Colorization	onnx	FP32
colorization-siggraph	Colorization	onnx	FP32
colorization-v2	Colorization	onnx	FP16-INT8
common-sign-language-0001	Image Classification	onnx	FP16
common-sign-language-0001	Image Classification	onnx	FP32
convbert-base-turkish-mc4-toxicity-uncased	Natural Language Processing	pytorch	intel-optimum default
convit_base	Image Classification	pytorch	FP32
convmixer_768_32	Image Classification	pytorch	FP32
convnext_base	Image Classification	pytorch	FP32
convnext-base-224	Image Classification	pytorch	intel-optimum default
crnn-tf	Image-to-Text	tf	FP16
crnn-tf	Image-to-Text	tf	FP32
crossvit_9_240	Image Classification	pytorch	FP32
cspdarknet53	Image Classification	pytorch	FP32
darknet19	Image Classification	tf	FP16
darknet19	Image Classification	tf	FP16-INT8
darknet19	Image Classification	tf	FP32
deberta-v3-large	Natural Language Processing	pytorch	intel-optimum default
deeplabv3	Semantic Segmentation	tf	FP16
deeplabv3	Semantic Segmentation	tf	FP16-INT8
deeplabv3	Semantic Segmentation	tf	FP32
deeplab-v3p-resnet50-os8	Semantic Segmentation	paddle	FP16
deeplab-v3p-resnet50-os8	Semantic Segmentation	paddle	FP16-INT8
deeplab-v3p-resnet50-os8	Semantic Segmentation	paddle	FP32
deit_base_distilled_patch16_224	Image Classification	pytorch	FP32
Denoise	Audio Enhancement	tf	FP16
Denoise	Audio Enhancement	tf	FP32
densenet-121-caffe	Image Classification	caffe	FP16
densenet-121-caffe	Image Classification	caffe	FP32
densenet-121-onnx	Image Classification	onnx	FP16
densenet-121-onnx	Image Classification	onnx	FP16-INT8
densenet-121-tf	Image Classification	tf	FP16
densenet-121-tf	Image Classification	tf	FP32
densenet-121-tf2	Image Classification	tf2	FP16
densenet-121-tf2	Image Classification	tf2	FP32
detr_resnet50	Object Detection	onnx	FP16
detr_resnet50	Object Detection	onnx	FP32
dien_alibaba	Behavior / Decision Prediction	tf	FP16
dien_alibaba	Behavior / Decision Prediction	tf	FP32
distilbert-base-cased	Natural Language Processing	onnx	FP16
distilbert-base-cased	Natural Language Processing	onnx	FP32
distilbert-base-nli-mean-tokens	Natural Language Processing	pytorch	intel-optimum default
distilbert-base-uncased	Natural Language Processing	onnx	FP16
distilbert-base-uncased	Natural Language Processing	onnx	FP16-INT8
distilbert-base-uncased-distilled-squad	Natural Language Processing	pytorch	intel-optimum default
distilbert-base-uncased-sst-2	Natural Language Processing	onnx	FP16
distilbert-base-uncased-sst-2	Natural Language Processing	onnx	FP16-INT8
distilbert-base-uncased-sst-2	Natural Language Processing	onnx	FP32
distilbert-NER	Natural Language Processing	pytorch	intel-optimum default
distil-large-v3	Speech Recognition	pytorch	intel-optimum default
distil-medium.en	Speech Recognition	pytorch	intel-optimum default
dla102	Image Classification	pytorch	FP32
dm_nfnet_f0	Image Classification	pytorch	FP32
dna_r9.4.1@v3	DNA Classification	onnx	FP16
dna_r9.4.1@v3	DNA Classification	onnx	FP32
dpn107	Image Classification	pytorch	FP32
dpn-68	Image Classification, Dual Path Network	onnx	FP16
dpn-68	Image Classification, Dual Path Network	onnx	FP16-INT8
dpn-68	Image Classification, Dual Path Network	onnx	FP32
east_resnet_v1_50	Image Classification	tf	FP16
east_resnet_v1_50	Image Classification	tf	FP16-INT8
east_resnet_v1_50	Image Classification	tf	FP32
ebgan	Image Processing, Enhancement	onnx	FP16
ebgan	Image Processing, Enhancement	onnx	FP32
eca_botnext26ts_256	Image Classification	pytorch	FP32
eca_halonext26ts	Image Classification	pytorch	FP32
edsr3_super_resolution	Image Processing, Enhancement	tf	FP16
edsr3_super_resolution	Image Processing, Enhancement	tf	FP32
edsr3-nas	Image Processing, Enhancement	onnx	FP16
edsr3-nas	Image Processing, Enhancement	onnx	FP32
efficientdet-d0-tf	Object Detection	tf	FP16
efficientdet-d0-tf	Object Detection	tf	FP16
efficientdet-d0-tf	Object Detection	tf	FP16-INT8
efficientdet-d0-tf	Object Detection	tf	FP16-INT8
efficientnet-b0-onnx	Object Detection	onnx	FP16
efficientnet-b0-onnx	Object Detection	onnx	FP16-INT8
efficientnet-b0-onnx	Object Detection	onnx	FP32
efficientnet-b0-tf	Object Detection	tf	FP16
efficientnet-b0-tf	Object Detection	tf	FP16-INT8
efficientnet-b0-tf	Object Detection	tf	FP32
efficientnet-lite4-11_efficientnet-lite4	Image Classification	onnx	FP16
efficientnet-lite4-11_efficientnet-lite4	Image Classification	onnx	FP32
efficientnet-v2-m	Object Detection	onnx	FP16
efficientnet-v2-m	Object Detection	onnx	FP16-INT8
efficientnet-v2-m	Object Detection	onnx	FP32
electra-base-french-europeana-cased-generator	Natural Language Processing	pytorch	intel-optimum default
electra-large-discriminator-nli-efl-tweeteval	Natural Language Processing	pytorch	intel-optimum default
emotion-ferplus-8_model	Object Detection	onnx	FP16
emotion-ferplus-8_model	Object Detection	onnx	FP32
emotions-recognition-retail-0003	Image Classification, Emotion	caffe	FP16
emotions-recognition-retail-0003	Image Classification, Emotion	caffe	FP16-INT8
ese_vovnet19b_dw	Image Classification	pytorch	FP32
esrgan	Image Processing, Enhancement	onnx	FP16
esrgan	Image Processing, Enhancement	onnx	FP16
esrgan	Image Processing, Enhancement	onnx	FP32
f3net	Object Detection	onnx	FP16
f3net	Object Detection	onnx	FP16-INT8
f3net	Object Detection	onnx	FP32
faceboxes-caffe	Object Detection	caffe	FP16
faceboxes-caffe	Object Detection	caffe	FP32
faceboxes-onnx	Object Detection	onnx	FP16
faceboxes-onnx	Object Detection	onnx	FP16-INT8
faceboxes-onnx	Object Detection	onnx	FP32
face-detection-0200	Object Detection	onnx	FP16
face-detection-0202	Object Detection	onnx	FP16
face-detection-0202	Object Detection	onnx	FP32
face-detection-0204	Object Detection	onnx	FP16
face-detection-adas-0001	Object Detection	caffe	FP16
face-detection-adas-0001	Object Detection	caffe	FP32
face-detection-retail-0004	Object Detection	caffe	FP16
face-detection-retail-0004	Object Detection	caffe	FP32
face-detection-retail-0044	Object Detection	caffe	FP16
face-detection-retail-0044	Object Detection	caffe	FP32
facenet	Object Detection	onnx	FP16
facenet	Object Detection	onnx	FP16-INT8
facenet-20180408-102900	Object Detection	tf	FP16
facenet-20180408-102900	Object Detection	tf	FP32
face-recognition-mobilefacenet-arcface	Object Detection	mxnet	FP16
face-recognition-mobilefacenet-arcface	Object Detection	mxnet	FP16-INT8
face-recognition-resnet50-arcface	Object Detection	mxnet	FP16
face-recognition-resnet50-aws	Object Detection	mxnet	FP16
face-recognition-resnet50-aws	Object Detection	mxnet	FP32
face-reidentification-retail-0095	Object Detection	onnx	FP16
face-reidentification-retail-0095	Object Detection	onnx	FP16-INT8
facial-landmarks-35-adas-0002	Object Detection	caffe	FP16
facial-landmarks-35-adas-0002	Object Detection	caffe	FP16-INT8
facial-landmarks-98-detection-0001	Object Detection	onnx	FP16
facial-landmarks-98-detection-0001	Object Detection	onnx	FP32
falcon-11B	Large Language Model	pytorch	intel-optimum default
falcon-7b	Large Language Model	pytorch	intel-optimum default
falcon-7b-instruct	Large Language Model	pytorch	intel-optimum default
faster_rcnn_inception_resnet_v2_atrous_coco	Object Detection	tf	FP16
faster_rcnn_inception_resnet_v2_atrous_coco	Object Detection	tf	FP32
faster_rcnn_inception_v2_coco	Object Detection	tf	FP16
faster_rcnn_inception_v2_coco	Object Detection	tf	FP32
faster_rcnn_resnet101_coco	Object Detection	tf	FP16
faster_rcnn_resnet101_coco	Object Detection	tf	FP32
faster_rcnn_resnet101_kitti	Object Detection	tf	FP16
faster_rcnn_resnet101_kitti	Object Detection	tf	FP32
faster_rcnn_resnet50_coco	Object Detection	tf	FP16
faster_rcnn_resnet50_coco	Object Detection	tf	FP16-INT8
faster_rcnn_resnet50_coco	Object Detection	tf	FP32
faster_rcnn_resnet50_fpn_coco	Object Detection	onnx	FP16
faster-rcnn-resnet101-coco-sparse-60-0001	Object Detection	tf	FP16
faster-rcnn-resnet101-coco-sparse-60-0001	Object Detection	tf	FP32
fastscnn	Object Detection	paddle	FP16
fastscnn	Object Detection	paddle	FP32
fastseg-small	Semantic Segmentation	onnx	FP16
fastseg-small	Semantic Segmentation	onnx	FP16-INT8
fastseg-small	Semantic Segmentation	onnx	FP32
fbnetc_100	Image Classification	pytorch	FP32
fbnetv3_b	Image Classification	pytorch	FP32
fcn-resnet101-11	Object Detection	onnx	FP16
fcn-resnet101-11	Object Detection	onnx	FP32
fcn-resnet50-11	Object Detection	onnx	FP16
fcn-resnet50-11	Object Detection	onnx	FP32
fcrn-dp-nyu-depth-v2-tf	Monodepth	tf	FP16
fcrn-dp-nyu-depth-v2-tf	Monodepth	tf	FP16-INT8
fcrn-dp-nyu-depth-v2-tf	Monodepth	tf	FP32
flaubert_base_cased	Natural Language Processing	pytorch	intel-optimum default
flaubert-base-uncased-finetuned-cooking	Natural Language Processing	pytorch	intel-optimum default
forward-tacotron-duration-prediction	Text-to-Speech	onnx	FP16
forward-tacotron-duration-prediction	Text-to-Speech	onnx	FP32
fsrcnn-x4	Image Processing, Enhancement	tf	FP16
fsrcnn-x4	Image Processing, Enhancement	tf	FP32
gaze-estimation-adas-0002	Object Detection	onnx	FP16
gemma-1.1-2b-it	Large Language Model	pytorch	intel-optimum default
gemma-1.1-7b-it	Large Language Model	pytorch	intel-optimum default
gemma-2b	Large Language Model	pytorch	intel-optimum default
gemma-2b-it	Large Language Model	pytorch	intel-optimum default
gemma-7b	Large Language Model	pytorch	intel-optimum default
gemma-7b-it	Large Language Model	pytorch	intel-optimum default
gernet_l	Image Classification	pytorch	FP32
ghostnet_100	Image Classification	pytorch	FP32
gluon_inception_v3	Image Classification	pytorch	FP32
gmixer_24_224	Image Classification	pytorch	FP32
gmlp_s16_224	Image Classification	pytorch	FP32
googlenet-12	Image Classification	onnx	FP16
googlenet-12	Image Classification	onnx	FP32
googlenet-v4-caffe	Image Classification	caffe	FP16
googlenet-v4-caffe	Image Classification	caffe	FP32
googlenet-v4-tf	Image Classification	tf	FP16
googlenet-v4-tf	Image Classification	tf	FP16-INT8
googlenet-v4-tf	Image Classification	tf	FP32
GPT-2	Large Language Model	onnx	FP16
GPT-2	Large Language Model	onnx	FP32
gpt2-lm-head-10_GPT-2-LM-HEAD	Large Language Model	onnx	FP16
gpt2-lm-head-10_GPT-2-LM-HEAD	Large Language Model	onnx	FP32
GPT2Neo1.3BPoints	Large Language Model	pytorch	intel-optimum default
granite-3b-code-base	Large Language Model	pytorch	intel-optimum default
granite-3b-code-instruct	Large Language Model	pytorch	intel-optimum default
granite-8b-code-base	Large Language Model	pytorch	intel-optimum default
granite-8b-code-instruct	Large Language Model	pytorch	intel-optimum default
handwritten-japanese-recognition-0001	Text Detection	onnx	FP16-INT8
hg-s8-b1-mpii	Object Detection	onnx	FP16
hg-s8-b1-mpii	Object Detection	onnx	FP16-INT8
higher-hrnet-w32-512	Object Detection	onnx	FP16
higher-hrnet-w32-512	Object Detection	onnx	FP32
horizontal-text-detection-0001	Text Detection	onnx	FP16
horizontal-text-detection-0001	Text Detection	onnx	FP16-INT8
horizontal-text-detection-0001	Text Detection	onnx	FP32
hrnet_w18	Image Classification	pytorch	FP32
hubert-large-ls960-ft	Speech Recognition	pytorch	intel-optimum default
human-pose-estimation-3d-0001	Object Detection	onnx	FP16
human-pose-estimation-3d-0001	Object Detection	onnx	FP32
hybrid-cs-model-mri	Image Processing, Enhancement	tf2	FP16
hybrid-cs-model-mri	Image Processing, Enhancement	tf2	FP32
i3d-flow	Action Recognition	tf	FP16
i3d-flow	Action Recognition	tf	FP16-INT8
i3d-flow	Action Recognition	tf	FP32
ibert-roberta-base	Natural Language Processing	pytorch	intel-optimum default
ibert-roberta-base-finetuned-mrpc	Natural Language Processing	pytorch	intel-optimum default
inception_v3	Image Classification	pytorch	FP32
inception-v1-12	Image Classification	onnx	FP16
inception-v1-12	Image Classification	onnx	FP32
inception-v2-7_model	Image Classification	onnx	FP16
inception-v2-7_model	Image Classification	onnx	FP32
instance-segmentation-security-0002	Instance Segmentation	onnx	FP16
instance-segmentation-security-0002	Instance Segmentation	onnx	FP32
instance-segmentation-security-0010	Instance Segmentation	onnx	FP16
instance-segmentation-security-0010	Instance Segmentation	onnx	FP32
internlm2-1_8b	Large Language Model	pytorch	intel-optimum default
internlm2-7b	Large Language Model	pytorch	intel-optimum default
internlm2-chat-1_8b	Large Language Model	pytorch	intel-optimum default
internlm2-chat-7b	Large Language Model	pytorch	intel-optimum default
internlm2-chat-7b-sft	Large Language Model	pytorch	intel-optimum default
internlm2-math-7b	Large Language Model	pytorch	intel-optimum default
internlm2-math-base-7b	Large Language Model	pytorch	intel-optimum default
jx_nest_base	Image Classification	pytorch	FP32
klue-roberta-base-ner	Natural Language Processing	pytorch	intel-optimum default
LCM_Dreamshaper_v7	Text-to-Image	pytorch	intel-optimum default
lcnet_050	Image Classification	pytorch	FP32
levit_128	Image Classification	pytorch	FP32
levit-256	Image Classification	pytorch	intel-optimum default
Llama-2-13b-chat-hf	Large Language Model	pytorch	intel-optimum default
Llama-2-13b-hf	Large Language Model	pytorch	intel-optimum default
Llama-2-7b-chat-hf	Large Language Model	pytorch	intel-optimum default
Llama-2-7b-hf	Large Language Model	pytorch	intel-optimum default
m2m100_418M	Natural Language Processing	pytorch	intel-optimum default
Magicoder-CL-7B	Large Language Model	pytorch	intel-optimum default
Magicoder-DS-6.7B	Large Language Model	pytorch	intel-optimum default
Magicoder-S-CL-7B	Large Language Model	pytorch	intel-optimum default
Magicoder-S-DS-6.7B	Large Language Model	pytorch	intel-optimum default
MarianCausalLM	Large Language Model	pytorch	intel-optimum default
marian-finetuned-kde4-en-to-cn-accelerate	Natural Language Processing	pytorch	intel-optimum default
mask_rcnn_inception_resnet_v2_atrous_coco	Instance Segmentation	tf	FP16
mask_rcnn_inception_resnet_v2_atrous_coco	Instance Segmentation	tf	FP32
mask_rcnn_inception_v2_coco	Instance Segmentation	tf	FP16
mask_rcnn_inception_v2_coco	Instance Segmentation	tf	FP16-INT8
mask_rcnn_inception_v2_coco	Instance Segmentation	tf	FP32
mask_rcnn_resnet101_atrous_coco	Instance Segmentation	tf	FP16
mask_rcnn_resnet101_atrous_coco	Instance Segmentation	tf	FP16-INT8
mask_rcnn_resnet50_atrous_coco	Instance Segmentation	tf	FP16
mask_rcnn_resnet50_atrous_coco	Instance Segmentation	tf	FP16-INT8
mask_rcnn_resnet50_atrous_coco	Instance Segmentation	tf	FP32
MaskRCNN-12	Object Detection	onnx	FP16
MaskRCNN-12	Object Detection	onnx	FP32
mbart-large-50-many-to-one-mmt	Natural Language Processing	pytorch	intel-optimum default
Meta-Llama-3-8B	Large Language Model	pytorch	intel-optimum default
Meta-Llama-3-8B-Instruct	Large Language Model	pytorch	intel-optimum default
Meta-Llama-Guard-2-8B	Large Language Model	pytorch	intel-optimum default
midasnet	Monodepth	onnx	FP16
midasnet	Monodepth	onnx	FP16-INT8
midasnet	Monodepth	onnx	FP32
MindChat-Qwen2-4B	Large Language Model	pytorch	intel-optimum default
MiniCPM-2B-sft-bf16	Large Language Model	pytorch	intel-optimum default
Mistral-7B-Instruct-v0.2	Large Language Model	pytorch	intel-optimum default
Mistral-7B-Instruct-v0.3	Large Language Model	pytorch	intel-optimum default
Mistral-7B-v0.3	Large Language Model	pytorch	intel-optimum default
mixer_b16_224	Image Classification	pytorch	FP32
mixnet_l	Image Classification	pytorch	FP32
mnasnet_100	Image Classification	pytorch	FP32
mnist-12	Image Classification	onnx	FP16
mnist-12	Image Classification	onnx	FP32
mobilebert	Natural Language Processing	onnx	FP16-INT8
mobilebert	Natural Language Processing	onnx	FP16-INT8
mobilenet-ssd	Object Detection	caffe	FP16
mobilenet-ssd	Object Detection	caffe	FP32
mobilenetv2_100	Image Classification	pytorch	FP32
mobilenet-v2-1.0-224-tf	Object Detection	tf	FP16
mobilenet-v2-1.0-224-tf	Object Detection	tf	FP16-INT8
mobilenet-v2-1.0-224-tf	Object Detection	tf	FP32
mobilenet-v2-1.0-224-tf2	Object Detection	tf2	FP16
mobilenet-v2-1.0-224-tf2	Object Detection	tf2	FP16-INT8
mobilenet-v2-1.0-224-tf2	Object Detection	tf2	FP32
mobilenet-v2-caffe	Object Detection	caffe	FP16
mobilenet-v2-caffe	Object Detection	caffe	FP32
mobilenet-v2-onnx	Object Detection	onnx	FP16
mobilenet-v2-onnx	Object Detection	onnx	FP16-INT8
mobilenet-v2-onnx	Object Detection	onnx	FP32
mobilenet-v2-paddle	Object Detection	paddle	FP16
mobilenet-v2-paddle	Object Detection	paddle	FP16-INT8
mobilenet-v2-paddle	Object Detection	paddle	FP32
mobilenetv3_large_100	Image Classification	pytorch	FP32
mobilenet-v3-large-1.0-224-onnx	Object Detection	onnx	FP16
mobilenet-v3-large-1.0-224-onnx	Object Detection	onnx	FP16-INT8
mobilenet-v3-large-1.0-224-onnx	Object Detection	onnx	FP32
mobilenet-v3-large-1.0-224-paddle	Object Detection	paddle	FP16
mobilenet-v3-large-1.0-224-paddle	Object Detection	paddle	FP16-INT8
mobilenet-v3-large-1.0-224-paddle	Object Detection	paddle	FP32
mobilenet-v3-large-1.0-224-tf	Object Detection	tf	FP16
mobilenet-v3-large-1.0-224-tf	Object Detection	tf	FP32
mobilenet-v3-large-1.0-224-tf2	Object Detection	tf2	FP16
mobilenet-v3-large-1.0-224-tf2	Object Detection	tf2	FP16-INT8
mobilenet-v3-large-1.0-224-tf2	Object Detection	tf2	FP32
mobilenet-yolo-v4-syg	Object Detection	tf	FP16-INT8
mobilenet-yolo-v4-syg	Object Detection	tf	FP32
mobilevit_s	Image Classification	pytorch	FP32
mobilevit-xx-small	Image Classification	pytorch	intel-optimum default
modnet_webcam_portrait_matting	Background Matting	onnx	FP16-INT8
mosaic-8_mosaic	Vision Style Transfer	onnx	FP16
mosaic-8_mosaic	Vision Style Transfer	onnx	FP32
mozilla-deepspeech-0.8.2	Speech Recognition	tf	FP16
mozilla-deepspeech-0.8.2	Speech Recognition	tf	FP16-INT8
mozilla-deepspeech-0.8.2	Speech Recognition	tf	FP32
mpt-7b	Large Language Model	pytorch	intel-optimum default
mpt-7b-8k	Large Language Model	pytorch	intel-optimum default
mpt-7b-8k-chat	Large Language Model	pytorch	intel-optimum default
mpt-7b-chat	Large Language Model	pytorch	intel-optimum default
mpt-7b-instruct	Large Language Model	pytorch	intel-optimum default
mpt-7b-storywriter	Large Language Model	pytorch	intel-optimum default
ms-marco-electra-base	Natural Language Processing	pytorch	intel-optimum default
mt5-base	Natural Language Processing	pytorch	intel-optimum default
mt5-large	Natural Language Processing	pytorch	intel-optimum default
mt5-small	Natural Language Processing	pytorch	intel-optimum default
mt5-tiny-random	Natural Language Processing	pytorch	intel-optimum default
neural-chat-7b-v1-1	Large Language Model	pytorch	intel-optimum default
neural-chat-7b-v3-3	Large Language Model	pytorch	intel-optimum default
nfnet_l0	Image Classification	pytorch	FP32
ocrnet-hrnet-w18	Text Detection	paddle	FP16
ocrnet-hrnet-w18	Text Detection	paddle	FP16-INT8
ocrnet-hrnet-w18	Text Detection	paddle	FP32
ocrnet-hrnet-w48	Text Detection	paddle	FP16
ocrnet-hrnet-w48	Text Detection	paddle	FP32
octave-resnext-101-0.25	Image Classification	mxnet	FP16
octave-resnext-101-0.25	Image Classification	mxnet	FP32
openchat-3.6-8b-20240522	Large Language Model	pytorch	intel-optimum default
open-closed-eye-0001	Image Classification	onnx	FP16
open-closed-eye-0001	Image Classification	onnx	FP16-INT8
open-closed-eye-0001	Image Classification	onnx	FP32
opt-1.3b	Large Language Model	pytorch	intel-optimum default
opt-125m	Large Language Model	pytorch	intel-optimum default
opt-13b	Large Language Model	pytorch	intel-optimum default
opt-2.7b	Large Language Model	pytorch	intel-optimum default
opt-350m	Large Language Model	pytorch	intel-optimum default
opt-6.7b	Large Language Model	pytorch	intel-optimum default
opt-iml-1.3b	Large Language Model	pytorch	intel-optimum default
pedestrian-detection-adas-0002	Object Detection	caffe	FP16
pedestrian-detection-adas-0002	Object Detection	caffe	FP16-INT8
pedestrian-detection-adas-0002	Object Detection	caffe	FP32
Pegasus-7b-slerp	Large Language Model	pytorch	intel-optimum default
pegasus-samsum	Large Language Model	pytorch	intel-optimum default
persimmon-8b-chat	Large Language Model	pytorch	intel-optimum default
person-detection-0100	Object Detection	onnx	FP16
person-detection-0101	Object Detection	onnx	FP16
person-detection-0201	Object Detection	onnx	FP16
person-detection-0201	Object Detection	onnx	FP32
person-vehicle-bike-detection-crossroad-0078	Object Detection	caffe	FP16
person-vehicle-bike-detection-crossroad-0078	Object Detection	caffe	FP16-INT8
person-vehicle-bike-detection-crossroad-0078	Object Detection	caffe	FP32
phi-2	Large Language Model	pytorch	intel-optimum default
Phi-3-medium-4k-instruct	Large Language Model	pytorch	intel-optimum default
Phi-3-mini-128k-instruct	Large Language Model	pytorch	intel-optimum default
pit_b_224	Image Classification	pytorch	FP32
pix2struct-base	Image-to-Text	pytorch	intel-optimum default
pix2struct-tiny-random	Image-to-Text	pytorch	intel-optimum default
pnasnet5large	Image Classification	pytorch	FP32
pointilism-8_pointilism	Vision Style Transfer	onnx	FP16
pointilism-8_pointilism	Vision Style Transfer	onnx	FP32
Polish_RoBERTa_large_OPI	Natural Language Processing	pytorch	intel-optimum default
poolformer_m36	Image Classification	pytorch	FP32
pp-ocr-det	Object Detection	paddle	FP16
pp-ocr-det	Object Detection	paddle	FP16-INT8
pp-ocr-det	Object Detection	paddle	FP32
pp-ocr-rec	Object Detection	paddle	FP16
pp-ocr-rec	Object Detection	paddle	FP32
pp-yolo	Object Detection	paddle	FP16
pp-yolo	Object Detection	paddle	FP32
prnet	Object Detection	tf	FP16
prnet	Object Detection	tf	FP16-INT8
prnet	Object Detection	tf	FP32
product-detection-0001	Object Detection	onnx	FP16
product-detection-0001	Object Detection	onnx	FP16-INT8
product-detection-0001	Object Detection	onnx	FP32
pythia-1.4b	Large Language Model	pytorch	intel-optimum default
pythia-12b	Large Language Model	pytorch	intel-optimum default
pythia-14m	Large Language Model	pytorch	intel-optimum default
pythia-160m	Large Language Model	pytorch	intel-optimum default
pythia-1b	Large Language Model	pytorch	intel-optimum default
pythia-2.8b	Large Language Model	pytorch	intel-optimum default
pythia-410m	Large Language Model	pytorch	intel-optimum default
pythia-6.9b	Large Language Model	pytorch	intel-optimum default
pythia-70m	Large Language Model	pytorch	intel-optimum default
Pythia-Chat-Base-7B	Large Language Model	pytorch	intel-optimum default
quartznet-15x5-en	Speech Recognition	onnx	FP16
quartznet-15x5-en	Speech Recognition	onnx	FP16-INT8
quartznet-15x5-en	Speech Recognition	onnx	FP32
Qwen1.5-0.5B	Large Language Model	pytorch	intel-optimum default
Qwen1.5-0.5B-Chat	Large Language Model	pytorch	intel-optimum default
Qwen1.5-1.8B	Large Language Model	pytorch	intel-optimum default
Qwen1.5-1.8B-Chat	Large Language Model	pytorch	intel-optimum default
Qwen1.5-4B	Large Language Model	pytorch	intel-optimum default
Qwen1.5-4B-Chat	Large Language Model	pytorch	intel-optimum default
Qwen1.5-7B	Large Language Model	pytorch	intel-optimum default
Qwen1.5-7B-Chat	Large Language Model	pytorch	intel-optimum default
Qwen-1_8B	Large Language Model	pytorch	intel-optimum default
Qwen-1_8B-Chat	Large Language Model	pytorch	intel-optimum default
Qwen-7B	Large Language Model	pytorch	intel-optimum default
Qwen-7B-Chat	Large Language Model	pytorch	intel-optimum default
rain-princess-8_rain_princess	Vision Style Transfer	onnx	FP16
rain-princess-8_rain_princess	Vision Style Transfer	onnx	FP32
rcnn-ilsvrc13-7_model	Image Classification	onnx	FP16
rcnn-ilsvrc13-7_model	Image Classification	onnx	FP32
really-tiny-falcon-testing	Large Language Model	pytorch	INT4
RedPajama-INCITE-7B-Base	Large Language Model	pytorch	intel-optimum default
RedPajama-INCITE-7B-Chat	Large Language Model	pytorch	intel-optimum default
RedPajama-INCITE-7B-Instruct	Large Language Model	pytorch	intel-optimum default
RedPajama-INCITE-Chat-3B-v1	Large Language Model	pytorch	intel-optimum default
regnety_002	Image Classification	pytorch	FP32
repvgg_a2	Image Classification	pytorch	FP32
res2net101_26w_4s	Image Classification	pytorch	FP32
res2net50_14w_8s	Image Classification	pytorch	FP32
res2next50	Image Classification	pytorch	FP32
resmlp_12_224	Image Classification	pytorch	FP32
resnest101e	Image Classification	pytorch	FP32
ResNet101-DUC-12	Object Detection	onnx	FP16
ResNet101-DUC-12	Object Detection	onnx	FP32
resnet101-v1-7	Image Classification	onnx	FP16
resnet101-v1-7	Image Classification	onnx	FP32
resnet101-v2-7	Image Classification	onnx	FP16
resnet101-v2-7	Image Classification	onnx	FP32
resnet152-v1-7	Image Classification	onnx	FP16
resnet152-v1-7	Image Classification	onnx	FP32
resnet152-v2-7	Image Classification	onnx	FP16
resnet152-v2-7	Image Classification	onnx	FP32
resnet-18	Image Classification	onnx	FP16
resnet-18	Image Classification	onnx	FP16-INT8
resnet-18	Image Classification	onnx	FP32
resnet18-v1-7	Image Classification	onnx	FP16
resnet18-v1-7	Image Classification	onnx	FP32
resnet18-v2-7	Image Classification	onnx	FP16
resnet18-v2-7	Image Classification	onnx	FP32
resnet34-v1-7	Image Classification	onnx	FP16
resnet34-v1-7	Image Classification	onnx	FP32
resnet34-v2-7	Image Classification	onnx	FP16
resnet34-v2-7	Image Classification	onnx	FP32
resnet50-caffe2-v1-7_model	Image Classification	onnx	FP16
resnet50-caffe2-v1-7_model	Image Classification	onnx	FP32
resnet-50-onnx	Image Classification	onnx	FP16
resnet-50-onnx	Image Classification	onnx	FP16-INT8
resnet-50-onnx	Image Classification	onnx	FP32
resnet-50-paddle	Image Classification	paddle	FP16
resnet-50-paddle	Image Classification	paddle	FP16-INT8
resnet-50-paddle	Image Classification	paddle	FP32
resnet-50-pytorch	Image Classification	onnx	FP16
resnet-50-pytorch	Image Classification	onnx	FP16-INT8
resnet-50-pytorch	Image Classification	onnx	FP32
resnet-50-tf	Image Classification	tf	FP16
resnet-50-tf	Image Classification	tf	FP16-INT8
resnet-50-tf	Image Classification	tf	FP32
resnet50-v2-7	Image Classification	onnx	FP16
resnet50-v2-7	Image Classification	onnx	FP32
resnext101-32x16d-swsl	Image Classification	onnx	FP16
resnext101-32x16d-swsl	Image Classification	onnx	FP16-INT8
resnext101-32x16d-swsl	Image Classification	onnx	FP32
resnext-101-32x8d	Image Classification	onnx	FP16
resnext-101-32x8d	Image Classification	onnx	FP32
retinanet	Image Classification	tf2	FP16
retinanet	Image Classification	tf2	FP32
retinanet_resnet34	Image Classification	onnx	FP16
retinanet_resnet34	Image Classification	onnx	FP16-INT8
retinanet_resnet34	Image Classification	onnx	FP32
retinanet-9_test_retinanet_resnet101	Object Detection	onnx	FP16
retinanet-9_test_retinanet_resnet101	Object Detection	onnx	FP32
rexnet_100	Image Classification	pytorch	FP32
rnnt	Speech Recognition	onnx	FP16
rnnt	Speech Recognition	onnx	FP32
road-segmentation-adas-0001	Semantic Segmentation	caffe	FP16
roberta-base	Natural Language Processing	onnx	FP16
roberta-base	Natural Language Processing	onnx	FP16-INT8
roberta-base	Natural Language Processing	onnx	FP32
roberta-base-mrpc	Natural Language Processing	onnx	FP16-INT8
roberta-base-mrpc	Natural Language Processing	onnx	FP16-INT8
roberta-base-squad2	Large Language Model	pytorch	intel-optimum default
roberta-large	Natural Language Processing	onnx	FP16
roberta-large	Natural Language Processing	onnx	FP32
roberta-large-mnli	Natural Language Processing	pytorch	intel-optimum default
roberta-large-ner-english	Natural Language Processing	pytorch	intel-optimum default
roberta-large-squadv2	Large Language Model	pytorch	intel-optimum default
roformer_small_generator	Natural Language Processing	pytorch	intel-optimum default
sbert-base-mean-tokens	Natural Language Processing	onnx	FP16
sbert-base-mean-tokens	Natural Language Processing	onnx	FP16-INT8
sbert-base-mean-tokens	Natural Language Processing	onnx	FP32
sebotnet33ts_256	Image Classification	pytorch	FP32
selecsls42b	Image Classification	pytorch	FP32
semantic-segmentation-adas-0001	Semantic Segmentation	caffe	FP16
semantic-segmentation-adas-0001	Semantic Segmentation	caffe	FP16-INT8
semantic-segmentation-adas-0001	Semantic Segmentation	caffe	FP32
se-resnet-50	Image Classification	caffe	FP16
se-resnet-50	Image Classification	caffe	FP32
se-resnext-101	Image Classification	caffe	FP16
se-resnext-101	Image Classification	caffe	FP32
se-resnext-50-caffe	Image Classification	caffe	FP16
se-resnext-50-caffe	Image Classification	caffe	FP32
se-resnext-50-onnx	Image Classification	onnx	FP16
se-resnext-50-onnx	Image Classification	onnx	FP16-INT8
se-resnext-50-onnx	Image Classification	onnx	FP32
se-resnext-50-tf	Image Classification	tf	FP16
se-resnext-50-tf	Image Classification	tf	FP32
sew-d-tiny-100k-ft-ls100h	Speech Recognition	pytorch	intel-optimum default
Sharpen-LensBlur	Image Processing, Enhancement	tf	FP16
Sharpen-LensBlur	Image Processing, Enhancement	tf	FP16-INT8
Sharpen-LensBlur	Image Processing, Enhancement	tf	FP32
Sharpen-MotionBlur	Image Processing, Enhancement	tf	FP16
Sharpen-MotionBlur	Image Processing, Enhancement	tf	FP16-INT8
Sharpen-MotionBlur	Image Processing, Enhancement	tf	FP32
Sharpen-Sharpen	Image Processing, Enhancement	tf	FP16
Sharpen-Sharpen	Image Processing, Enhancement	tf	FP16-INT8
Sharpen-Sharpen	Image Processing, Enhancement	tf	FP32
shufflenet-7_model	Image Classification	onnx	FP16
shufflenet-7_model	Image Classification	onnx	FP32
shufflenet-v2-x1.0-onnx	Image Classification	onnx	FP16
shufflenet-v2-x1.0-onnx	Image Classification	onnx	FP16-INT8
shufflenet-v2-x1.0-onnx	Image Classification	onnx	FP32
shufflenet-v2-x1.0-tf	Image Classification	tf	FP16
shufflenet-v2-x1.0-tf	Image Classification	tf	FP16-INT8
shufflenet-v2-x1.0-tf	Image Classification	tf	FP32
single-image-super-resolution-1032	Image Processing, Enhancement	onnx	FP16
Sphereface	Image Classification	caffe	FP16
Sphereface	Image Classification	caffe	FP32
spnasnet_100	Image Classification	pytorch	FP32
squeezenet1.0-12	Image Classification	onnx	FP16
squeezenet1.0-12	Image Classification	onnx	FP32
squeezenet1.1-caffe	Image Classification	caffe	FP16
squeezenet1.1-caffe	Image Classification	caffe	FP32
squeezenet1.1-mxnet	Image Classification	mxnet	FP16
squeezenet1.1-mxnet	Image Classification	mxnet	FP32
squeezenet1.1-onnx	Image Classification	onnx	FP32
srgan-onnx	Image Processing, Enhancement	onnx	FP16
srgan-tf	Image Processing, Enhancement	tf	FP16
srgan-tf	Image Processing, Enhancement	tf	FP16-INT8
srgan-tf	Image Processing, Enhancement	tf	FP32
ssd_mobilenet_v1_10_ssd_mobilenet_v1	Object Detection	onnx	FP16
ssd_mobilenet_v1_coco	Object Detection	tf	FP16
ssd_mobilenet_v1_coco	Object Detection	tf	FP16-INT8
ssd_mobilenet_v1_coco	Object Detection	tf	FP32
ssd-10	Object Detection	onnx	FP16
ssd-10	Object Detection	onnx	FP32
ssd300-onnx-0001	Object Detection	onnx	FP16
ssd300-onnx-0001	Object Detection	onnx	FP16-INT8
ssdlite_mobilenet_v2	Object Detection	tf	FP16
ssdlite_mobilenet_v2	Object Detection	tf	FP16-INT8
ssdlite_mobilenet_v2	Object Detection	tf	FP32
ssdlite-mobilenet-v3-small-320-coco	Object Detection	paddle	FP16
ssdlite-mobilenet-v3-small-320-coco	Object Detection	paddle	FP32
ssd-resnet34-1200	Object Detection	onnx	FP16
ssd-resnet34-1200	Object Detection	onnx	FP16-INT8
ssd-resnet34-1200	Object Detection	onnx	FP32
stable-diffusion-2-1	Image-to-Text & Text-to-Image	pytorch	intel-optimum default
stable-diffusion-v1-4	Image-to-Text & Text-to-Image	pytorch	intel-optimum default
stable-diffusion-v1-5	Image-to-Text & Text-to-Image	pytorch	intel-optimum default
stable-diffusion-xl-base-1.0	Image-to-Text & Text-to-Image	pytorch	intel-optimum default
stablelm-2-1_6b	Large Language Model	pytorch	intel-optimum default
stablelm-2-1_6b-chat	Large Language Model	pytorch	intel-optimum default
stablelm-2-12b	Large Language Model	pytorch	intel-optimum default
stablelm-2-12b-chat	Large Language Model	pytorch	intel-optimum default
stablelm-2-zephyr-1_6b	Large Language Model	pytorch	intel-optimum default
stablelm-3b-4e1t	Large Language Model	pytorch	intel-optimum default
stablelm-base-alpha-3b	Large Language Model	pytorch	intel-optimum default
stablelm-tuned-alpha-7b	Large Language Model	pytorch	intel-optimum default
stablelm-zephyr-3b	Large Language Model	pytorch	intel-optimum default
stsb-bert-tiny-safetensors	Natural Language Processing	pytorch	intel-optimum default
style_transfer	Image Processing	onnx	FP16
style_transfer	Image Processing	onnx	FP16-INT8
style_transfer	Image Processing	onnx	FP32
stylegan2	Image Processing	tf	FP16
stylegan2	Image Processing	tf	FP32
super-resolution-10_super_resolution	Image Manipulation	onnx	FP16
super-resolution-10_super_resolution	Image Manipulation	onnx	FP32
sup-simcse-roberta-base	Natural Language Processing	pytorch	intel-optimum default
swin_base_patch4_window7_224	Image Classification	pytorch	FP32
swin-tiny-patch4-window7-224	Image Classification	onnx	FP16
swin-tiny-patch4-window7-224	Image Classification	onnx	FP16-INT8
swin-tiny-patch4-window7-224	Image Classification	onnx	FP32
swsl_resnext101_32x16d	Image Classification	pytorch	FP32
t2t-vit-7	Image Classification	onnx	FP16
t2t-vit-7	Image Classification	onnx	FP16-INT8
t2t-vit-7	Image Classification	onnx	FP32
t5-base	Natural Language Processing	pytorch	intel-optimum default
t5-decoder-with-lm-head-12_t5-decoder-with-lm-head	Natural Language Processing	onnx	FP16
t5-decoder-with-lm-head-12_t5-decoder-with-lm-head	Natural Language Processing	onnx	FP32
t5-encoder-12_t5-encoder	Natural Language Processing	onnx	FP16
t5-encoder-12_t5-encoder	Natural Language Processing	onnx	FP32
t5-large	Natural Language Processing	pytorch	intel-optimum default
t5-small	Natural Language Processing	pytorch	intel-optimum default
tedlium_dnn4_smbr	Speech Recognition	kaldi	FP16
tedlium_dnn4_smbr	Speech Recognition	kaldi	FP16-INT8
tedlium_dnn4_smbr	Speech Recognition	kaldi	FP32
text-image-super-resolution-0001	Image Processing, Enhancement	onnx	FP16
text-image-super-resolution-0001	Image Processing, Enhancement	onnx	FP16-INT8
text-image-super-resolution-0001	Image Processing, Enhancement	onnx	FP32
text-recognition-0012	Text Detection	tf	FP16
text-recognition-0012	Text Detection	tf	FP32
text-recognition-0013	Text Detection	onnx	FP16
text-recognition-0013	Text Detection	onnx	FP32
text-recognition-0014	Text Detection	onnx	FP16
text-recognition-0014	Text Detection	onnx	FP16-INT8
text-recognition-0014	Text Detection	onnx	FP32
text-to-speech-en-multi-0001	Text-to-Speech	null	FP32
tf_efficientnet_b0	Image Classification	pytorch	FP32
tf_mixnet_l	Image Classification	pytorch	FP32
tiny_yolo_v2	Object Detection	onnx	FP16
tiny_yolo_v2	Object Detection	onnx	FP32
tinybert_6layer_768dim_cola	Natural Language Processing	onnx	FP16
tinybert_6layer_768dim_cola	Natural Language Processing	onnx	FP16-INT8
tinybert_6layer_768dim_cola	Natural Language Processing	onnx	FP32
tiny-doc-qa-vision-encoder-decoder	Image-to-Text	pytorch	intel-optimum default
tiny-llama-fast-tokenizer	Large Language Model	pytorch	INT4
tiny-marian-en-de	Large Language Model	pytorch	INT4
tiny-mixtral	Large Language Model	pytorch	INT4
tinynet_a	Image Classification	pytorch	FP32
tiny-random-albert	Natural Language Processing	pytorch	intel-optimum default
tiny-random-aquila2	Large Language Model	pytorch	INT4
tiny-random-aquilachat	Large Language Model	pytorch	INT4
tiny-random-baichuan2	Large Language Model	pytorch	INT4
tiny-random-baichuan2-13b	Large Language Model	pytorch	INT4
tiny-random-bart	Large Language Model	pytorch	INT4
tiny-random-BeitForImageClassification	Image Classification	pytorch	intel-optimum default
tiny-random-bert	Natural Language Processing	pytorch	intel-optimum default
tiny-random-BlenderbotModel	Large Language Model	pytorch	INT4
tiny-random-BloomModel	Large Language Model	pytorch	INT4
tiny-random-chatglm2	Large Language Model	pytorch	INT4
tiny-random-codegen2	Large Language Model	pytorch	INT4
tiny-random-CodeGenForCausalLM	Large Language Model	pytorch	INT4
tiny-random-CohereForCausalLM	Large Language Model	pytorch	INT4
tiny-random-ConvBertForSequenceClassification	Natural Language Processing	pytorch	intel-optimum default
tiny-random-convnext	Image Classification	pytorch	intel-optimum default
tiny-random-Data2VecAudioModel	Speech Recognition	pytorch	intel-optimum default
tiny-random-dbrx	Large Language Model	pytorch	INT4
tiny-random-deberta	Natural Language Processing	pytorch	intel-optimum default
tiny-random-distilbert	Natural Language Processing	pytorch	intel-optimum default
tiny-random-electra	Natural Language Processing	pytorch	intel-optimum default
tiny-random-falcon-40b	Large Language Model	pytorch	INT4
tiny-random-flaubert	Natural Language Processing	pytorch	intel-optimum default
tiny-random-GemmaForCausalLM	Large Language Model	pytorch	INT4
tiny-random-gpt2	Large Language Model	pytorch	INT4
tiny-random-GPTNeoModel	Large Language Model	pytorch	INT4
tiny-random-GPTNeoXForCausalLM	Large Language Model	pytorch	INT4
tiny-random-HubertModel	Speech Recognition	pytorch	intel-optimum default
tiny-random-ibert	Natural Language Processing	pytorch	intel-optimum default
tiny-random-internlm	Large Language Model	pytorch	INT4
tiny-random-internlm2	Large Language Model	pytorch	INT4
tiny-random-latent-consistency	Text-to-Image	pytorch	intel-optimum default
tiny-random-LevitModel	Image Classification	pytorch	intel-optimum default
tiny-random-m2m_100	Natural Language Processing	pytorch	intel-optimum default
tiny-random-mbart	Natural Language Processing	pytorch	intel-optimum default
tiny-random-minicpm	Large Language Model	pytorch	INT4
tiny-random-mistral	Large Language Model	pytorch	INT4
tiny-random-MobileNetV2Model	Image Classification	pytorch	intel-optimum default
tiny-random-mobilevit	Image Classification	pytorch	intel-optimum default
tiny-random-MptForCausalLM	Large Language Model	pytorch	INT4
tiny-random-olmo-hf	Large Language Model	pytorch	INT4
tiny-random-OPTModel	Large Language Model	pytorch	INT4
tiny-random-orion	Large Language Model	pytorch	INT4
tiny-random-pegasus	Large Language Model	pytorch	INT4
tiny-random-PersimmonForCausalLM	Large Language Model	pytorch	INT4
tiny-random-phi3	Large Language Model	pytorch	INT4
tiny-random-PhiForCausalLM	Large Language Model	pytorch	INT4
tiny-random-qwen	Large Language Model	pytorch	INT4
tiny-random-qwen1.5-moe	Large Language Model	pytorch	INT4
tiny-random-resnet	Image Classification	pytorch	intel-optimum default
tiny-random-roberta	Natural Language Processing	pytorch	intel-optimum default
tiny-random-roformer	Natural Language Processing	pytorch	intel-optimum default
tiny-random-SEWModel	Speech Recognition	pytorch	intel-optimum default
tiny-random-squeezebert	Natural Language Processing	pytorch	intel-optimum default
tiny-random-stable-diffusion-xl	Text-to-Image	pytorch	intel-optimum default
tiny-random-stable-diffusion-xl-refiner	Text-to-Image	pytorch	intel-optimum default
tiny-random-StableLmForCausalLM	Large Language Model	pytorch	INT4
tiny-random-Starcoder2ForCausalLM	Large Language Model	pytorch	INT4
tiny-random-t5	Natural Language Processing	pytorch	intel-optimum default
tiny-random-unispeech	Audio Classification	pytorch	intel-optimum default
tiny-random-UnispeechSatModel	Speech Recognition	pytorch	intel-optimum default
tiny-random-VisionEncoderDecoderModel-vit-gpt2	Image-to-Text	pytorch	intel-optimum default
tiny-random-vit	Image Classification	pytorch	intel-optimum default
tiny-random-wav2vec2-conformer	Speech Recognition	pytorch	intel-optimum default
tiny-random-Wav2Vec2Model	Speech Recognition	pytorch	intel-optimum default
tiny-random-WavlmModel	Speech Recognition	pytorch	intel-optimum default
tiny-random-xlm	Natural Language Processing	pytorch	intel-optimum default
tiny-random-xverse	Large Language Model	pytorch	INT4
tiny-stable-diffusion-torch	Text-to-Image	pytorch	intel-optimum default
tiny-xlm-roberta	Natural Language Processing	pytorch	intel-optimum default
tiramisu-fc-densenet-103	Object Detection	tf2	FP16
tiramisu-fc-densenet-103	Object Detection	tf2	FP16-INT8
tiramisu-fc-densenet-103	Object Detection	tf2	FP32
tnt_s_patch16_224	Image Classification	pytorch	FP32
topaz_video_super_resolution	Image Processing, Enhancement	tf	FP16
topaz_video_super_resolution	Image Processing, Enhancement	tf	FP32
trocr-base-handwritten	Image-to-Text	pytorch	intel-optimum default
trocr-small-handwritten	Image-to-Text	pytorch	intel-optimum default
twins_pcpvt_base	Image Classification	pytorch	FP32
twitter-roberta-base-sentiment-latest	Natural Language Processing	pytorch	intel-optimum default
udnie-8_udnie	Neural Style Transfer	onnx	FP16
udnie-8_udnie	Neural Style Transfer	onnx	FP32
ultra-lightweight-face-detection-rfb-320	Object Detection	onnx	FP16
ultra-lightweight-face-detection-slim-320	Object Detection	onnx	FP16
unet-2d	Semantic Segmentation	onnx	FP16
unet3d_mlperf-onnx	Semantic Segmentation	onnx	FP16
unet3d_mlperf-onnx	Semantic Segmentation	onnx	FP16-INT8
unet3d_mlperf-onnx	Semantic Segmentation	onnx	FP32
unet3d_mlperf-tf	Semantic Segmentation	tf	FP16
unet3d_mlperf-tf	Semantic Segmentation	tf	FP16-INT8
unet-camvid-onnx-0001	Semantic Segmentation	onnx	FP16
unet-camvid-onnx-0001	Semantic Segmentation	onnx	FP16-INT8
unet-camvid-onnx-0001	Semantic Segmentation	onnx	FP32
unispeech-1350-en-90-it-ft-1h	Speech Recognition	pytorch	intel-optimum default
unispeech-sat-base-plus-sd	Audio	pytorch	intel-optimum default
unispeech-sat-base-sv	Audio	pytorch	intel-optimum default
unispeech-sat-large-sv	Audio	pytorch	intel-optimum default
urlnet	URL Classification	tf2	FP16
urlnet	URL Classification	tf2	FP32
vehicle-detection-adas-0002	Object Detection	caffe	FP16
version-RFB-320	Object Detection	onnx	FP16
version-RFB-320	Object Detection	onnx	FP32
version-RFB-640	Object Detection	onnx	FP16
version-RFB-640	Object Detection	onnx	FP32
vgg16-12	Image Classification	onnx	FP16
vgg16-12	Image Classification	onnx	FP32
vgg19-7_vgg19	Image Classification	onnx	FP16
vgg19-7_vgg19	Image Classification	onnx	FP32
vgg19-caffe2-7_model	Image Classification	onnx	FP16
vgg19-caffe2-7_model	Image Classification	onnx	FP32
visformer_small	Image Classification	pytorch	FP32
vit_base_patch16_224	Image Feature Extraction	pytorch	FP32
vitstr-small-patch16-224	Text Detection	onnx	FP16
vitstr-small-patch16-224	Text Detection	onnx	FP32
vit-with-attentions	Image Classification	pytorch	intel-optimum default
vit-with-hidden_states	Image Classification	pytorch	intel-optimum default
volo_d1_224	Image Classification	pytorch	FP32
wav2vec2-base	Speech Recognition	onnx	FP16
wav2vec2-base	Speech Recognition	onnx	FP16-INT8
wav2vec2-base	Speech Recognition	onnx	FP32
wav2vec2-base-superb-sd	Audio Classification	pytorch	intel-optimum default
wav2vec2-base-superb-sid	Audio Classification	pytorch	intel-optimum default
wav2vec2-base-superb-sv	Audio	pytorch	intel-optimum default
wav2vec2-random-tiny-classifier	Audio Classification	pytorch	intel-optimum default
wavernn-rnn	Text-to-Speech	onnx	FP16
wavernn-rnn	Text-to-Speech	onnx	FP32
wavernn-upsampler	Text-to-Speech	onnx	FP16
wavernn-upsampler	Text-to-Speech	onnx	FP32
wdsr-small-x4	Image Processing, Enhancement	onnx	FP16
wdsr-small-x4	Image Processing, Enhancement	onnx	FP16-INT8
wdsr-small-x4	Image Processing, Enhancement	onnx	FP32
weld-porosity-detection-0001	Image Classification	onnx	FP16
weld-porosity-detection-0001	Image Classification	onnx	FP32
whisper-base	Speech Reognition	pytorch	intel-optimum default
whisper-large-v2	Speech Reognition	pytorch	intel-optimum default
whisper-medium	Speech Reognition	pytorch	intel-optimum default
whisper-small	Speech Reognition	pytorch	intel-optimum default
whisper-tiny.en	Speech Recognition	pytorch	intel-optimum default
WizardMath-7B-V1.1	Large Language Model	pytorch	intel-optimum default
xcit_large_24_p8_224	Image Classification	pytorch	FP32
xlm-clm-ende-1024	Natural Language Processing	pytorch	intel-optimum default
xlm-roberta-base	Natural Language Processing	onnx	FP16
xlm-roberta-base	Natural Language Processing	onnx	FP32
xlm-roberta-base-language-detection	Natural Language Processing	pytorch	intel-optimum default
xlm-roberta-base-uncased-conll2003	Natural Language Processing	pytorch	intel-optimum default
xlm-roberta-large	Natural Language Processing	pytorch	intel-optimum default
xlm-roberta-large-en-ru-mnli	Natural Language Processing	pytorch	intel-optimum default
xlm-roberta-large-finetuned-conll03-english	Natural Language Processing	pytorch	intel-optimum default
XVERSE-7B-Chat	Large Language Model	pytorch	intel-optimum default
yolo_v3_tiny	Object Detection	onnx	FP16
yolo_v3_tiny-onnx	Object Detection	onnx	FP16
yolo_v3_tiny-onnx	Object Detection	onnx	FP16-INT8
yolo_v3_tiny-onnx	Object Detection	onnx	FP32
yolo_v3_tiny-tf	Object Detection	tf	FP16
yolo_v3_tiny-tf	Object Detection	tf	FP16-INT8
yolo_v3_tiny-tf	Object Detection	tf	FP32
yolo_v3-onnx	Object Detection	onnx	FP16
yolo_v3-onnx	Object Detection	onnx	FP16
yolo_v4-tf	Object Detection	tf	FP16
yolo_v4-tf	Object Detection	tf	FP16-INT8
yolo_v4-tf	Object Detection	tf	FP32
yolo_v4-tf2	Object Detection	tf2	FP16
yolo_v4-tf2	Object Detection	tf2	FP16-INT8
yolo_v5l	Object Detection	onnx	FP16
yolo_v5l	Object Detection	onnx	FP16-INT8
yolo_v5l	Object Detection	onnx	FP32
yolo_v5m	Object Detection	onnx	FP16
yolo_v5m	Object Detection	onnx	FP16-INT8
yolo_v5m	Object Detection	onnx	FP32
yolo_v5m-v6	Object Detection	onnx	FP16
yolo_v5m-v6	Object Detection	onnx	FP16-INT8
yolo_v5m-v6	Object Detection	onnx	FP32
yolo_v5s	Object Detection	onnx	FP16
yolo_v5s	Object Detection	onnx	FP16-INT8
yolo_v5s	Object Detection	onnx	FP32
yolo_v5s-v6	Object Detection	onnx	FP16
yolo_v5s-v6	Object Detection	onnx	FP16-INT8
yolo_v5s-v6	Object Detection	onnx	FP32
yolo_v5x	Object Detection	onnx	FP16
yolo_v5x	Object Detection	onnx	FP32
yolo_v8n	Object Detection	onnx	FP16
yolo_v8n	Object Detection	onnx	FP16-INT8
yolo_v8n	Object Detection	onnx	FP32
yolof	Object Detection	onnx	FP16
yolof	Object Detection	onnx	FP16-INT8
yolof	Object Detection	onnx	FP32
yolor_p6	Object Detection	onnx	FP16
yolor_p6	Object Detection	onnx	FP16-INT8
yolor_p6	Object Detection	onnx	FP32
yolo-v2-ava-0001	Object Detection	tf	FP16
yolo-v2-ava-0001	Object Detection	tf	FP16-INT8
yolo-v2-ava-0001	Object Detection	tf	FP32
yolo-v2-ava-sparse-70-0001	Object Detection	tf	FP16
yolo-v2-ava-sparse-70-0001	Object Detection	tf	FP16-INT8
yolo-v2-ava-sparse-70-0001	Object Detection	tf	FP32
yolov2-coco-9	Object Detection	onnx	FP16
yolov2-coco-9	Object Detection	onnx	FP32
yolo-v3-caffe	Object Detection	caffe	FP16
yolo-v3-caffe	Object Detection	caffe	FP32
yolo-v3-tf	Object Detection	tf	FP16
yolo-v3-tf	Object Detection	tf	FP32
yolov4	Object Detection	onnx	FP16
yolov4	Object Detection	onnx	FP32
zephyr-7b-beta	Large Language Model	pytorch	intel-optimum default
zfnet512-12	Image Classification	onnx	FP16
zfnet512-12	Image Classification	onnx	FP32

Marked cells indicate models that passed inference with no errors. Empty cells indicate models that were not tested. No failing runs producing an error have been recorded.

In the precision column, the “optimum-intel default” label corresponds to FP32 for small models and INT8 for models greater than 1B parameters.

The results as of June 17 2024, for OpenVINO version 2024.2.

The models come from different public model repositories, such as Pytorch Model Zoo and HuggingFace; they were executed on the designated hardware with OpenVINO either natively or as a backend.