Skip to main content
Back to top
Ctrl
+
K
Site Navigation
Install
Blog
Forum
Support
GitHub
GitHub
English
English
Chinese
Site Navigation
Install
Blog
Forum
Support
GitHub
GitHub
English
English
Chinese
Section Navigation
GET STARTED
Install OpenVINO
OpenVINO Runtime on Linux
Use Archive
Use PyPI
Use APT
Use YUM
Use ZYPPER
Use Conda Forge
Use vcpkg
Use Homebrew
Use Conan
Use Docker
Use npm
OpenVINO Runtime on Windows
Use Archive
Use PyPI
Use Conda Forge
Use vcpkg
Use Docker
Use Conan
Use npm
OpenVINO Runtime on macOS
Use Archive
Use Homebrew
Use PyPI
Use Conda Forge
Use vcpkg
Use Conan
Use npm
Additional Hardware Setup
For GPU
For NPU
Troubleshooting
LEARN OPENVINO
Interactive Tutorials (Python)
Installation of OpenVINO™ Notebooks
Live 3D Human Pose Estimation with OpenVINO
Part Segmentation of 3D Point Clouds with OpenVINO™
Human Action Recognition with OpenVINO™
Lightweight image generation with aMUSEd and OpenVINO
Image-to-Video synthesis with AnimateAnyone and OpenVINO
Asynchronous Inference with OpenVINO™
Automatic Device Selection with OpenVINO™
Text-to-speech generation using Bark and OpenVINO
Subject-driven image generation and editing using BLIP Diffusion and OpenVINO
Visual Question Answering and Image Captioning using BLIP and OpenVINO
Language-Visual Saliency with CLIP and OpenVINO™
Zero-shot Image Classification with OpenAI CLIP and OpenVINO™
Programming Language Classification with OpenVINO
Text-to-Image Generation with ControlNet Conditioning
OpenVINO™ Model conversion
Classification with ConvNeXt and OpenVINO
Cross-lingual Books Alignment with Transformers and OpenVINO™
Live Inference and Benchmark CT-scan Data with OpenVINO™
Quantize a Segmentation Model and Show Live Inference
Image generation with DeciDiffusion and OpenVINO
Image generation with DeepFloyd IF and OpenVINO™
Post-Training Quantization and Weights Compression of DeepFloyd IF model with NNCF
Depth estimation with DepthAnything and OpenVINO
Monocular Visual-Inertial Depth Estimation using OpenVINO™
Convert Detectron2 Models to OpenVINO™
Automatic speech recognition using Distil-Whisper and OpenVINO
Sentiment Analysis with OpenVINO™
Instruction following using Databricks Dolly 2.0 and OpenVINO
Object segmentations with EfficientSAM and OpenVINO
Audio compression with EnCodec and OpenVINO
Object segmentations with FastSAM and OpenVINO
FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
Frame interpolation using FILM and OpenVINO
Working with GPUs in OpenVINO™
Grammatical Error Correction with OpenVINO
Object detection and masking from prompts with GroundedSAM (GroundingDINO + SAM) and OpenVINO
Handwritten Chinese and Japanese OCR with OpenVINO™
Hello Object Detection
Hello Image Segmentation
Hello Image Classification
Hugging Face Model Hub with OpenVINO™
Binding multimodal data using ImageBind and OpenVINO
Quantization of Image Classification Models
Image In-painting with OpenVINO™
InstantID: Zero-shot Identity-Preserving Generation using OpenVINO
Image Editing with InstructPix2Pix and OpenVINO
OpenVINO optimizations for Knowledge graphs
Kosmos-2: Multimodal Large Language Model and OpenVINO
Quantize NLP models with Post-Training Quantization in NNCF
Performance tricks in OpenVINO for latency mode
Image generation with Latent Consistency Model and OpenVINO
Latent Consistency Model using Optimum-Intel OpenVINO
Text-to-Image Generation with LCM LoRA and ControlNet Conditioning
OpenVINO™ model conversion API
Visual-language assistant with LLaVA and OpenVINO
Visual-language assistant with LLaVA Next and OpenVINO
Create LLM Agent using OpenVINO
Create an LLM-powered Chatbot using OpenVINO
LLM Instruction-following pipeline with OpenVINO
Create a RAG system using OpenVINO and LangChain
Semantic segmentation with LRASPP MobileNet v3 and OpenVINO
Machine translation demo
Magika: AI powered fast and efficient file type identification using OpenVINO
Industrial Meter Reader
MMS: Scaling Speech Technology to 1000+ languages with OpenVINO™
Visual Content Search using MobileCLIP and OpenVINO
Mobile language assistant with MobileVLM and OpenVINO
Hello Model Server
Working with Open Model Zoo Models
Controllable Music Generation with MusicGen and OpenVINO
Named entity recognition with OpenVINO™
Live Object Detection with OpenVINO™
Universal Segmentation with OneFormer and OpenVINO
OpenVINO™ Runtime API Tutorial
OpenVINO Tokenizers: Incorporate Text Processing Into OpenVINO Pipelines
Voice tone cloning with OpenVoice and OpenVINO
Optical Character Recognition (OCR) with OpenVINO™
Optimize Preprocessing
PaddleOCR with OpenVINO™
Convert a PaddlePaddle Model to OpenVINO™ IR
Paint By Example: Exemplar-based Image Editing with Diffusion Models
Person Tracking with OpenVINO™
Document Visual Question Answering Using Pix2Struct and OpenVINO™
Live Human Pose Estimation with OpenVINO™
Speaker diarization
Convert a PyTorch Model to ONNX and OpenVINO™ IR
Post-Training Quantization of PyTorch models with NNCF
Quantization Aware Training with NNCF, using PyTorch framework
Convert a PyTorch Model to OpenVINO™ IR
Generate creative QR codes with ControlNet QR Code Monster and OpenVINO™
Interactive question answering with OpenVINO™
Text-to-Music generation using Riffusion and OpenVINO
Background removal with RMBG v1.4 and OpenVINO
Single step image generation using SDXL-turbo and OpenVINO
Object masks from prompts with SAM and OpenVINO
Semantic Segmentation with OpenVINO™ using Segmenter
High-resolution image generation with Segmind-VegaRT and OpenVINO
Zero-shot Image Classification with SigLIP
Video Recognition using SlowFast and OpenVINO™
SoftVC VITS Singing Voice Conversion and OpenVINO™
Sound Generation with AudioLDM2 and OpenVINO™
Accelerate Inference of Sparse Transformer Models with OpenVINO™ and 4th Gen Intel® Xeon® Scalable Processors
Text Generation via Speculative Sampling, KV Caching, and OpenVINO™
Quantize Data2Vec Speech Recognition Model using NNCF PTQ API
Quantize Wav2Vec Speech Recognition Model using NNCF PTQ API
Speech to Text with OpenVINO™
Image generation with Segmind Stable Diffusion 1B (SSD-1B) model and OpenVINO
Image Generation with Stable Diffusion and IP-Adapter
Text-to-Image Generation with Stable Diffusion and OpenVINO™
Stable Diffusion v2.1 using OpenVINO TorchDynamo backend
Infinite Zoom Stable Diffusion v2 and OpenVINO™
Stable Diffusion v2.1 using Optimum-Intel OpenVINO and multiple Intel Hardware
Stable Diffusion Text-to-Image Demo
Text-to-Image Generation with Stable Diffusion v2 and OpenVINO™
Image generation with Stable Diffusion XL and OpenVINO
LLM-powered chatbot using Stable-Zephyr-3b and OpenVINO
Style Transfer with OpenVINO™
Table Question Answering using TAPAS and OpenVINO™
Big Transfer Image Classification Model Quantization pipeline with NNCF
Convert a TensorFlow Model to OpenVINO™
Convert of TensorFlow Hub models to OpenVINO Intermediate Representation (IR)
Convert a TensorFlow Instance Segmentation Model to OpenVINO™
Convert a TensorFlow Object Detection Model to OpenVINO™
Quantization Aware Training with NNCF, using TensorFlow Framework
Post-Training Quantization with TensorFlow Classification Model
From Training to Deployment with TensorFlow and OpenVINO™
Text Prediction with OpenVINO™
Selfie Segmentation using TFLite and OpenVINO
Convert a Tensorflow Lite Model to OpenVINO™
Performance tricks in OpenVINO for throughput mode
Image Generation with Tiny-SD and OpenVINO™
TripoSR feedforward 3D reconstruction from a single image and OpenVINO
Typo Detector with OpenVINO™
Vehicle Detection And Recognition with OpenVINO™
Visual-language assistant with Video-LLaVA and OpenVINO
Image Background Removal with U^2-Net and OpenVINO™
Image Colorization with OpenVINO
Monodepth Estimation with OpenVINO
Photos to Anime with PaddleGAN and OpenVINO
Super Resolution with PaddleGAN and OpenVINO™
Single Image Super Resolution with OpenVINO™
Video Super Resolution with OpenVINO™
Video Subtitle Generation using Whisper and OpenVINO™
Post-Training Quantization of OpenAI Whisper model with NNCF
Image generation with Würstchen and OpenVINO
Convert and Optimize YOLOv7 with OpenVINO™
Convert and Optimize YOLOv8 instance segmentation model with OpenVINO™
Convert and Optimize YOLOv8 keypoint detection model with OpenVINO™
YOLOv8 Oriented Bounding Boxes Object Detection with OpenVINO™
Convert and Optimize YOLOv8 real-time object detection with OpenVINO™
Convert and Optimize YOLOv8 with OpenVINO™
Convert and Optimize YOLOv9 with OpenVINO™
Video generation with ZeroScope and OpenVINO
Sample Applications (Python & C++)
Get Started with Samples
Hello Classification Sample
Hello NV12 Input Classification Sample
Hello Query Device Sample
Hello Reshape SSD Sample
Image Classification Async Sample
Model Creation Sample
Sync Benchmark Sample
Throughput Benchmark Sample
Bert Benchmark Python Sample
Benchmark Tool
Large Language Model Inference Guide
LLM Inference with Optimum Intel
LLM Inference with OpenVINO API
OpenVINO Tokenizers
OPENVINO WORKFLOW
Model Preparation
Convert to OpenVINO Model
Convert from PyTorch
Convert from TensorFlow
Convert from ONNX
Convert from TensorFlow Lite
Convert from PaddlePaddle
Conversion Parameters
Setting Input Shapes
Model Optimization and Compression
Quantizing Models Post-training
Basic Quantization Flow
Quantizing with Accuracy Control
Compressing Models During Training
Quantization-aware Training (QAT)
Filter Pruning of Convolutional Models
Weight Compression
Running Inference
Integrate OpenVINO™ with Your Application
Model Representation in OpenVINO™ Runtime
OpenVINO™ Inference Request
OpenVINO™ Runtime Python API Advanced Inference
OpenVINO™ Python API Exclusives
Inference Devices and Modes
CPU Device
GPU Device
Remote Tensor API of GPU Plugin
NPU Device
Automatic Device Selection
Debugging Auto-Device Plugin
Multi-device execution
Heterogeneous execution
Automatic Batching
Query Device Properties - Configuration
Changing Input Shapes
Dynamic Shapes
When Dynamic Shapes API is Not Applicable
Stateful models and State API
Obtaining a Stateful OpenVINO Model
String Tensors
Optimize Inference
General Optimizations
High-level Performance Hints
Precision Control
Optimizing for Latency
Model Caching Overview
Optimizing for Throughput
Advanced Throughput Options
Optimize Preprocessing
Preprocessing API - details
Layout API Overview
Use Case - Integrate and Save Preprocessing Steps Into IR
Torchvision preprocessing converter
Further Low-Level Implementation Details
Optimizing memory usage
Deployment on a Local System
Local Distribution Libraries
Optimize Binaries Size
Deployment on a Model Server
Quickstart Guide
Setup Model Server
Prepare a Model Repository
Use Cloud Storage
Model Server Parameters
Using AI Accelerators
Security Considerations
Deploy Model Server
Write a Client Application
TensorFlow Serving API
gRPC API
RESTful API
Examples
KServe API
gRPC API
RESTful API
Examples
OpenVINO Model Server C-API
Model Server Features
Directed Acyclic Graph (DAG) Scheduler
Demultiplexing in DAG
Custom Node Development Guide
Integration with mediapipe
gRPC Streaming API
Python Execution in OpenVINO Model Server
Serving Stateful Models
Support for Binary Encoded Image Input Data
Input Shape and Layout Considerations
Predict on Binary Inputs via TensorFlow Serving API
Predict on Binary Inputs via KServe API
Convert TensorFlow Models to Accept Binary Inputs
Support for text data format
Batch, Shape and Layout
Dynamic Input Parameters
Dynamic Shape with dynamic IR/ONNX Model
Dynamic Shape with Binary Inputs
Dynamic Batch Size with Automatic Model Reloading
Dynamic Shape with Automatic Model Reloading
Dynamic batch size with OpenVINO™ Model Server Demultiplexer
Dynamic Shape with a Custom Node
Online Configuration Updates
Model Version Policy
Metrics
OpenVINO Model Server C-API
Advanced Features
CPU Extensions
Model Cache
Custom Model Loader
Securing Model Server with NGINX
Performance tuning
Demos
CLIP image classification
Age and Gender Recognition via REST API
Horizontal Text Detection in Real-Time
Optical Character Recognition with Directed Acyclic Graph
Face Detection Demo
Face Blur Pipeline Demo with OVMS
C API inference demo (C/C++)
Single Face Analysis Pipeline Demo
Multi Faces Analysis Pipeline Demo
Model Ensemble Pipeline Demo
MediaPipe Image Classification Demo
MediaPipe Multi Model Demo
MediaPipe Object Detection Demo
MediaPipe Holistic Demo
MediaPipe Iris Demo
Image Classification Demos
Image Classification Demo (Python)
Image Classification Demo (C++)
Image Classification Demo (Go)
Prediction Example with an ONNX Model
Model Server demo with a direct import of TensorFlow model
Person, vehicle, bike detection with multiple data sources
Vehicle Analysis Pipeline Demo
Real Time Stream Analysis Demo
Segmentation Example with a PaddlePaddle Model
BERT Question Answering Demo
Using inputs data in string format with universal-sentence-encoder model
Benchmark Client
Benchmark Client (Python)
Benchmark Client (C++)
Seq2seq demo with python node
Stable diffusion demo with python node
String output model demo
Troubleshooting
PyTorch Deployment via “torch.compile”
DOCUMENTATION
API Reference
OpenVINO Python API
openvino
openvino.runtime
openvino.runtime.op
openvino.runtime.op.util
openvino.runtime.opset1
openvino.runtime.opset2
openvino.runtime.opset3
openvino.runtime.opset4
openvino.runtime.opset5
openvino.runtime.opset6
openvino.runtime.opset7
openvino.runtime.opset8
openvino.runtime.opset9
openvino.runtime.opset10
openvino.runtime.opset11
openvino.runtime.opset12
openvino.runtime.opset13
openvino.runtime.opset14
openvino.runtime.passes
openvino.preprocess
openvino.properties
openvino.properties.device
openvino.properties.hint
openvino.properties.intel_auto
openvino.properties.intel_cpu
openvino.properties.intel_gpu
openvino.properties.intel_gpu.hint
openvino.properties.log
openvino.properties.streams
openvino.frontend
Group OpenVINO Runtime C++ API
Basics
Layout
ov::Layout
Element types
ov::element::Type
ov::Dimension
ov::Extension
ov::Model
ov::Node
ov::PartialShape
ov::preprocess::PrePostProcessor
ov::Shape
ov::Symbol
ov::DiscreteTypeInfo
Operations
ov::op::internal::AUGRUCell
ov::op::internal::AUGRUSequence
ov::op::internal::RPE
ov::op::v0::Abs
ov::op::v0::Acos
ov::op::v3::Acosh
ov::op::v8::AdaptiveAvgPool
ov::op::v8::AdaptiveMaxPool
ov::op::v1::Add
ov::op::v0::Asin
ov::op::v3::Assign
ov::op::v6::Assign
ov::op::v0::Atan
ov::op::v3::Atanh
ov::op::v1::AvgPool
ov::op::v14::AvgPool
ov::op::v0::BatchNormInference
ov::op::v5::BatchNormInference
ov::op::v1::BatchToSpace
ov::op::v1::BinaryConvolution
ov::op::v13::BitwiseAnd
ov::op::v13::BitwiseNot
ov::op::v13::BitwiseOr
ov::op::v13::BitwiseXor
ov::op::v3::Broadcast
ov::op::v1::Broadcast
ov::op::v3::Bucketize
ov::op::v0::Ceiling
ov::op::v0::Clamp
ov::op::v0::Concat
ov::op::v0::Constant
ov::op::v0::Constant::LPBuffer
ov::op::v0::Convert
ov::op::v1::ConvertLike
ov::op::v14::ConvertPromoteTypes
ov::op::v1::Convolution
ov::op::v1::ConvolutionBackpropData
ov::op::v0::Cos
ov::op::v0::Cosh
ov::op::v0::CTCGreedyDecoder
ov::op::v6::CTCGreedyDecoderSeqLen
ov::op::v4::CTCLoss
ov::op::v0::CumSum
ov::op::v1::DeformableConvolution
ov::op::v8::DeformableConvolution
ov::op::v1::DeformablePSROIPooling
ov::op::v0::DepthToSpace
ov::op::v7::DFT
ov::op::v1::Divide
ov::op::v7::Einsum
ov::op::v0::Elu
ov::op::v3::EmbeddingSegmentsSum
ov::op::v3::EmbeddingBagOffsetsSum
ov::op::v3::EmbeddingBagPackedSum
ov::op::v1::Equal
ov::op::v0::Erf
ov::op::v0::Exp
ov::op::v6::ExperimentalDetectronDetectionOutput
ov::op::v6::ExperimentalDetectronDetectionOutput::Attributes
ov::op::v6::ExperimentalDetectronGenerateProposalsSingleImage
ov::op::v6::ExperimentalDetectronGenerateProposalsSingleImage::Attributes
ov::op::v6::ExperimentalDetectronPriorGridGenerator
ov::op::v6::ExperimentalDetectronPriorGridGenerator::Attributes
ov::op::v6::ExperimentalDetectronROIFeatureExtractor
ov::op::v6::ExperimentalDetectronROIFeatureExtractor::Attributes
ov::op::v6::ExperimentalDetectronTopKROIs
ov::op::v3::ExtractImagePatches
ov::op::v9::Eye
ov::op::v13::FakeConvert
ov::op::v0::FakeQuantize
ov::op::v0::Floor
ov::op::v1::FloorMod
ov::op::v1::Gather
ov::op::v7::Gather
ov::op::v8::Gather
ov::op::v6::GatherElements
ov::op::v5::GatherND
ov::op::v8::GatherND
ov::op::v1::GatherTree
ov::op::v0::Gelu
ov::op::v7::Gelu
ov::op::v1::Greater
ov::op::v1::GreaterEqual
ov::op::v9::GridSample
ov::op::v9::GridSample::Attributes
ov::op::v12::GroupNormalization
ov::op::v3::GRUCell
ov::op::v5::GRUSequence
ov::op::v0::HardSigmoid
ov::op::v5::HSigmoid
ov::op::v4::HSwish
ov::op::v8::I420toBGR
ov::op::v8::I420toRGB
ov::op::v7::IDFT
ov::op::v8::If
ov::op::v0::Interpolate
ov::op::v0::Interpolate::Attributes
ov::op::v4::Interpolate
ov::op::v11::Interpolate
ov::op::v14::Inverse
ov::op::v10::IsFinite
ov::op::v10::IsInf
ov::op::v10::IsInf::Attributes
ov::op::v10::IsNaN
ov::op::v1::Less
ov::op::v1::LessEqual
ov::op::v0::Log
ov::op::v5::LogSoftmax
ov::op::v1::LogicalAnd
ov::op::v1::LogicalNot
ov::op::v1::LogicalOr
ov::op::v1::LogicalXor
ov::op::v5::Loop
ov::op::v5::Loop::SpecialBodyPorts
ov::op::v0::LRN
ov::op::v0::LSTMCell
ov::op::v4::LSTMCell
ov::op::v0::LSTMSequence
ov::op::v5::LSTMSequence
ov::op::v0::MatMul
ov::op::v8::MatrixNms
ov::op::v8::MatrixNms::Attributes
ov::op::v1::MaxPool
ov::op::v8::MaxPool
ov::op::v14::MaxPool
ov::op::v1::Maximum
ov::op::v1::Minimum
ov::op::v4::Mish
ov::op::v1::Mod
ov::op::v13::Multinomial
ov::op::v1::Multiply
ov::op::v0::MVN
ov::op::v6::MVN
ov::op::v0::Negative
ov::op::v1::NonMaxSuppression
ov::op::v3::NonMaxSuppression
ov::op::v4::NonMaxSuppression
ov::op::v5::NonMaxSuppression
ov::op::v3::NonZero
ov::op::v0::NormalizeL2
ov::op::v1::NotEqual
ov::op::v8::NV12toBGR
ov::op::v8::NV12toRGB
ov::op::v1::OneHot
ov::op::Op
ov::op::v1::Pad
ov::op::v12::Pad
ov::op::v0::Parameter
ov::op::v1::Power
ov::op::v0::PRelu
ov::op::v0::PriorBox
ov::op::v0::PriorBox::Attributes
ov::op::v8::PriorBox
ov::op::v8::PriorBox::Attributes
ov::op::v0::PriorBoxClustered
ov::op::v0::PriorBoxClustered::Attributes
ov::op::v0::Proposal
ov::op::v0::Proposal::Attributes
ov::op::v4::Proposal
ov::op::v0::PSROIPooling
ov::op::v8::RandomUniform
ov::op::v4::Range
ov::op::v0::Range
ov::op::v3::ReadValue
ov::op::v6::ReadValue
ov::op::v4::ReduceL1
ov::op::v4::ReduceL2
ov::op::v1::ReduceLogicalAnd
ov::op::v1::ReduceLogicalOr
ov::op::v1::ReduceMax
ov::op::v1::ReduceMean
ov::op::v1::ReduceMin
ov::op::v1::ReduceProd
ov::op::v1::ReduceSum
ov::op::v0::RegionYolo
ov::op::v0::Relu
ov::op::v0::ReorgYolo
ov::op::v1::Reshape
ov::op::v0::Result
ov::op::v1::Reverse
ov::op::v0::ReverseSequence
ov::op::v14::RMSNorm
ov::op::v0::RNNCell
ov::op::v5::RNNSequence
ov::op::v3::ROIAlign
ov::op::v14::ROIAlignRotated
ov::op::v0::ROIPooling
ov::op::v7::Roll
ov::op::v5::Round
ov::op::v13::ScaledDotProductAttention
ov::op::v3::ScatterElementsUpdate
ov::op::v3::ScatterNDUpdate
ov::op::v15::ScatterNDUpdate
ov::op::v3::ScatterUpdate
ov::op::v1::Select
ov::op::v0::Selu
ov::op::v3::ShapeOf
ov::op::v0::ShapeOf
ov::op::v0::ShuffleChannels
ov::op::v0::Sigmoid
ov::op::v0::Sign
ov::op::v0::Sin
ov::op::v0::Sinh
ov::op::Sink
ov::op::v8::Slice
ov::op::v1::Softmax
ov::op::v8::Softmax
ov::op::v4::SoftPlus
ov::op::v1::SpaceToBatch
ov::op::v0::SpaceToDepth
ov::op::v1::Split
ov::op::v0::Sqrt
ov::op::v0::SquaredDifference
ov::op::v0::Squeeze
ov::op::v1::StridedSlice
ov::op::v1::Subtract
ov::op::v4::Swish
ov::op::v0::Tan
ov::op::v0::Tanh
ov::op::v0::TensorIterator
ov::op::v0::Tile
ov::op::v1::TopK
ov::op::v3::TopK
ov::op::v11::TopK
ov::op::v1::Transpose
ov::op::v10::Unique
ov::op::v0::Unsqueeze
ov::op::v1::VariadicSplit
ov::op::v0::Xor
Operation sets
ov::OpSet
Transformation passes
ov::pass::ConstantFolding
ov::pass::ConvertFP32ToFP16
ov::pass::MatcherPass
ov::pass::GraphRewrite
ov::pass::LowLatency2
ov::pass::MakeStateful
ov::pass::Manager
ov::pass::PassBase
ov::pass::ModelPass
ov::pass::PassConfig
ov::pass::SDPAToPagedAttention
ov::pass::Serialize
ov::pass::StreamSerialize
ov::pass::StreamSerialize::DataHeader
ov::pass::Validate
ov::pass::VisualizeTree
Inference
Intel CPU specific properties
Intel GPU OpenCL interoperability
ov::intel_gpu::ocl::D3DBufferTensor
ov::intel_gpu::ocl::D3DSurface2DTensor
ov::intel_gpu::ocl::D3DContext
ov::intel_gpu::ocl::ClBufferTensor
ov::intel_gpu::ocl::ClImage2DTensor
ov::intel_gpu::ocl::USMTensor
ov::intel_gpu::ocl::ClContext
ov::intel_gpu::ocl::VASurfaceTensor
ov::intel_gpu::ocl::VAContext
Intel GPU OpenCL specific properties
Intel NPU specific properties
Device properties
ov::device::Priorities
ov::device::Properties
ov::device::UUID
ov::device::LUID
ov::device::PCIInfo
ov::streams::Num
ov::Allocator
ov::Allocator::Base
ov::Allocator::Impl
ov::Tensor
ov::CompiledModel
ov::Core
ov::Cancelled
ov::Busy
ov::InferRequest
ov::RemoteContext
ov::RemoteTensor
ov::VariableState
ov::ProfilingInfo
Group OpenVINO Runtime C API
Basics
Compiled Model
ov_compiled_model_t
Core
ov_core_t
ov_version
ov_core_version
ov_core_version_list
ov_available_devices_t
Dimension
ov_dimension
Infer Request
ov_infer_request_t
ov_callback_t
ov_ProfilingInfo_t
ov_profiling_info_list_t
Layout
ov_layout_t
Model
ov_model_t
Node
ov_output_const_port_t
ov_output_port_t
Partial Shape
ov_partial_shape
Pre Post Process
ov_preprocess_prepostprocessor_t
ov_preprocess_input_info_t
ov_preprocess_input_tensor_info_t
ov_preprocess_output_info_t
ov_preprocess_output_tensor_info_t
ov_preprocess_input_model_info_t
ov_preprocess_preprocess_steps_t
Property
Rank
ov_rank_t
Shape
ov_shape_t
Tensor
ov_tensor_t
Remote Context
OpenVINO Node.js API
addon
element
resizeAlgorithm
CompiledModel
Core
CoreConstructor
InferRequest
InputInfo
InputModelInfo
InputTensorInfo
Model
Output
OutputInfo
OutputTensorInfo
PartialShape
PartialShapeConstructor
PrePostProcessor
PrePostProcessorConstructor
PreProcessSteps
Tensor
TensorConstructor
OpenVINO IR format and Operation Sets
Operation Sets in OpenVINO
Available Operation Sets
opset14
opset13
opset12
opset11
opset10
opset9
opset8
opset7
opset6
opset5
opset4
opset3
opset2
opset1
Operation Specifications
Abs-1
Acos-1
Acosh-3
AdaptiveAvgPool-8
AdaptiveMaxPool-8
Add-1
Asin-1
Asinh-3
Assign-3
Assign-6
Atan-1
Atanh-3
AvgPool-1
AvgPool-14
BatchNormInference-1
BatchNormInference-5
BatchToSpace-2
BinaryConvolution-1
BitwiseAnd-13
BitwiseNot-13
BitwiseOr-13
BitwiseXor-13
Broadcast-1
Broadcast-3
Bucketize-3
CTCGreedyDecoder-1
CTCGreedyDecoderSeqLen-6
Ceiling-1
Clamp-1
Concat-1
Constant-1
ConvertLike-1
ConvertPromoteTypes-14
Convert-1
ConvolutionBackpropData-1
Convolution-1
Cos-1
Cosh-1
CTCLoss-4
CumSum-3
DeformableConvolution-1
DeformableConvolution-8
DeformablePSROIPooling-1
DepthToSpace-1
DetectionOutput-1
DetectionOutput-8
DFT-7
Divide-1
Einsum-7
Elu-1
EmbeddingBagOffsetsSum-3
EmbeddingBagPackedSum-3
EmbeddingSegmentsSum-3
Equal-1
Erf-1
Exp-1
ExperimentalDetectronDetectionOutput-6
ExperimentalDetectronGenerateProposalsSingleImage-6
ExperimentalDetectronPriorGridGenerator-6
ExperimentalDetectronROIFeatureExtractor-6
ExperimentalDetectronTopKROIs-6
ExtractImagePatches-3
Eye-9
FakeConvert-13
FakeQuantize-1
FloorMod-1
Floor-1
GridSample-9
GRN-1
GRUCell-3
GRUSequence-5
GatherTree-1
Gather-1
Gather-7
Gather-8
GatherElements-6
GatherND-5
GatherND-8
GELU-2
GELU-7
GenerateProposals-9
GreaterEqual-1
Greater-1
GroupConvolutionBackpropData-1
GroupConvolution-1
GroupNormalization-12
HardSigmoid-1
HSigmoid-5
HSwish-4
I420toBGR-8
I420toRGB-8
IDFT-7
IRDFT-9
If-8
Interpolate-1
Interpolate-4
Interpolate-11
IsFinite-10
IsInf-10
IsNaN-10
LRN-1
LSTMCell-1
LSTMSequence-1
LessEqual-1
Less-1
Log-1
LogicalAnd-1
LogicalNot-1
LogicalOr-1
LogicalXor-1
LogSoftmax-5
Loop-5
MVN-1
MVN-6
MatMul-1
MatrixNms-8
MaxPool-1
MaxPool-8
MaxPool-14
Maximum-1
Minimum-1
Mish-4
Mod-1
MulticlassNonMaxSuppression-8
MulticlassNonMaxSuppression-9
Multinomial-13
Multiply-1
Negative-1
NMSRotated-13
NonMaxSuppression-1
NonMaxSuppression-3
NonMaxSuppression-4
NonMaxSuppression-5
NonMaxSuppression-9
NonZero-3
NormalizeL2-1
NotEqual-1
NV12toBGR-8
NV12toRGB-8
OneHot-1
PReLU-1
PSROIPooling-1
Pad-1
Pad-12
Parameter-1
Power-1
PriorBoxClustered-1
PriorBox-1
PriorBox-8
Proposal-1
Proposal-4
RandomUniform-8
Range-1
Range-4
RDFT-9
ReadValue-3
ReadValue-6
ReLU-1
ReduceL1-4
ReduceL2-4
ReduceLogicalAnd-1
ReduceLogicalOr-1
ReduceMax-1
ReduceMean-1
ReduceMin-1
ReduceProd-1
ReduceSum-1
RegionYolo-1
ReorgYolo-1
Reshape-1
Result-1
Reverse-1
ReverseSequence-1
RNNCell-3
RNNSequence-5
ROIAlign-3
ROIAlign-9
ROIAlignRotated-14
ROIPooling-1
Roll-7
Round-5
ScaledDotProductAttention-13
ScatterElementsUpdate-3
ScatterElementsUpdate-12
ScatterNDUpdate-3
ScatterUpdate-3
Select-1
Selu-1
ShapeOf-1
ShapeOf-3
ShuffleChannels-1
Sigmoid-1
Sign-1
Sin-1
Sinh-1
Slice-8
SoftMax-1
SoftMax-8
SoftPlus-4
SoftSign-9
SpaceToBatch-2
SpaceToDepth-1
Split-1
Sqrt-1
SquaredDifference-1
Squeeze-1
StridedSlice-1
Subtract-1
Swish-4
Tan-1
Tanh-1
TensorIterator-1
Tile-1
TopK-1
TopK-3
TopK-11
Transpose-1
Unique-10
Unsqueeze-1
VariadicSplit-1
Broadcast Rules For Elementwise Operations
Intermediate Representation Suitable for INT8 Inference
Legacy Features
OpenVINO Development Tools package
Model Optimizer / Conversion API
Legacy Conversion API
Setting Input Shapes
Troubleshooting Reshape Errors
Cutting Off Parts of a Model
Embedding Preprocessing Computation
Compressing a Model to FP16
Convert Models Represented as Python Objects
Model Optimizer Frequently Asked Questions
Supported Model Formats
Converting a TensorFlow Model
Converting an ONNX Model
Converting a PyTorch Model
Converting a TensorFlow Lite Model
Converting a PaddlePaddle Model
Model Conversion Tutorials
Converting a TensorFlow Attention OCR Model
Converting a TensorFlow BERT Model
Converting a TensorFlow CRNN Model
Converting a TensorFlow DeepSpeech Model
Converting TensorFlow EfficientDet Models
Converting TensorFlow FaceNet Models
Converting a TensorFlow GNMT Model
Converting a TensorFlow Language Model on One Billion Word Benchmark
Converting a TensorFlow Neural Collaborative Filtering Model
Converting TensorFlow Object Detection API Models
Converting a TensorFlow RetinaNet Model
Converting TensorFlow Slim Image Classification Model Library Models
Converting TensorFlow Wide and Deep Family Models
Converting a TensorFlow XLNet Model
Converting TensorFlow YOLO Models
Converting an ONNX Faster R-CNN Model
Converting an ONNX GPT-2 Model
Converting an ONNX Mask R-CNN Model
Converting a PyTorch BERT-NER Model
Converting a PyTorch Cascade RCNN R-101 Model
Converting a PyTorch F3Net Model
Converting a PyTorch QuartzNet Model
Converting a PyTorch RCAN Model
Converting a PyTorch RNN-T Model
Converting a PyTorch YOLACT Model
Legacy Model Optimizer Extensibility
[LEGACY] Graph Traversal and Modification
[LEGACY] Model Optimizer Extensions
[LEGACY] Model Optimizer Operation
[LEGACY] Operation Extractor
[LEGACY] Graph Transformation Extensions
[LEGACY] Extending Model Optimizer with Caffe Python Layers
Open Model ZOO
Overview of OpenVINO™ Toolkit Intel’s Pre-Trained Models
Overview of OpenVINO™ Toolkit Public Pre-Trained Models
Model Downloader and other automation tools
Deep Learning accuracy validation framework
Dataset Preparation Guide
Open Model Zoo Demos
OpenVINO Model Server Adapter
Tool Ecosystem
OpenVINO™ Training Extensions
Datumaro
OpenVINO™ Security Add-on
OpenVINO Extensibility
Custom OpenVINO Operations
Frontend Extensions
How to Implement Custom GPU Operations
Overview of Transformations API
OpenVINO Model Pass
OpenVINO Matcher Pass
OpenVINO Graph Rewrite Pass
OpenVINO Plugin Developer Guide
Implement Plugin Functionality
Implement Compiled Model Functionality
Implement Synchronous Inference Request
Implement Asynchronous Inference Request
Provide Plugin Specific Properties
Implement Remote Context
Implement Remote Tensor
Build Plugin Using CMake
Plugin Testing
Advanced Topics
Quantized models compute and restrictions
Representation of low-precision models
OpenVINO™ Low Precision Transformations
Attributes
AvgPoolPrecisionPreserved
IntervalsAlignment
PrecisionPreserved
Precisions
QuantizationAlignment
QuantizationGranularity
Step 1. Prerequisites transformations
PullReshapeThroughDequantization
PullTransposeThroughDequantization
LinOpSequenceFusion
Step 2. Markup transformations
MarkupBias
MarkupCanBeQuantized
MarkupPrecisions
MarkupPerTensorQuantization
MarkupAvgPoolPrecisionPreserved
PropagatePrecisions
AlignQuantizationIntervals
AlignQuantizationParameters
CreateAttribute
CreatePrecisionsDependentAttribute
PropagateThroughPrecisionPreserved
PropagateToInput
UpdateSharedPrecisionPreserved
Step 3. Main transformations
AddTransformation
AvgPoolTransformation
BatchToSpaceTransformation
ClampTransformation
ConcatTransformation
ConvolutionTransformation
ConvolutionBackpropDataTransformation
FakeQuantizeDecompositionTransformation
FakeQuantizeTransformation
InterpolateTransformation
GroupConvolutionTransformation
GatherTransformation
MatMulTransformation
MaxPoolTransformation
MultiplyPartialTransformation
MVNTransformation
NormalizeL2Transformation
PadTransformation
PReluTransformation
ReduceMaxTransformation
ReduceMeanTransformation
ReduceMinTransformation
ReduceSumTransformation
ReluTransformation
ReshapeTransformation
SpaceToBatchTransformation
SqueezeTransformation
ShuffleChannelsTransformation
SplitTransformation
StridedSliceTransformation
TransposeTransformation
UnsqueezeTransformation
VariadicSplitTransformation
Step 4. Cleanup transformations
EliminateFakeQuantizeTransformation
FoldConvertTransformation
FoldFakeQuantizeTransformation
FuseConvertTransformation
FuseMultiplyToFakeQuantizeTransformation
FuseSubtractToFakeQuantizeTransformation
MultiplyToGroupConvolutionTransformation
Plugin API Reference
Group OpenVINO Plugin API
Plugin base classes
Compiled Model base classes
ov::ICompiledModel
Inference Request common classes
ov::IInferRequest
Inference Request base classes
ov::ISyncInferRequest
ov::ISyncInferRequest::FoundPort
Asynchronous Inference Request base classes
ov::IAsyncInferRequest
ov::IAsyncInferRequest::DisableCallbackGuard
Variable state base classes
Threading utilities
ov::threading::ImmediateExecutor
ov::threading::CPUStreamsExecutor
System configuration utilities
Execution model utilities
ov::exec_model_info::ExecutionNode
Error handling and debug helpers
ITT profiling utilities
openvino::itt::ScopedTask
openvino::itt::TaskChain
Group OpenVINO Transformation API
Runtime information
Common optimization passes
ov::pass::low_precision::AddTransformation
ov::pass::low_precision::AlignQuantizationIntervals
ov::pass::low_precision::AlignQuantizationParameters
ov::pass::low_precision::AvgPoolTransformation
ov::pass::low_precision::BatchToSpaceTransformation
ov::pass::low_precision::ClampTransformation
ov::pass::low_precision::CleanupTransformation
ov::pass::low_precision::ConcatTransformation
ov::pass::low_precision::ConvertSubtractConstant
ov::pass::low_precision::ConvolutionTransformation
ov::pass::low_precision::ConvolutionBackpropDataTransformation
ov::pass::low_precision::CreateAttribute
ov::pass::low_precision::CreatePrecisionsDependentAttribute
ov::pass::low_precision::DepthToSpaceTransformation
ov::pass::low_precision::EliminateFakeQuantizeTransformation
ov::pass::low_precision::EltwiseBaseTransformation
ov::pass::low_precision::FakeQuantizeTransformation
ov::pass::low_precision::FakeQuantizeDecompositionTransformation
ov::pass::low_precision::FoldConvertTransformation
ov::pass::low_precision::FoldFakeQuantizeTransformation
ov::pass::low_precision::FuseConvertTransformation
ov::pass::low_precision::FuseElementwiseToFakeQuantizeTransformation
ov::pass::low_precision::FuseMultiplyToFakeQuantizeTransformation
ov::pass::low_precision::FuseSubtractToFakeQuantizeTransformation
ov::pass::low_precision::GroupConvolutionTransformation
ov::pass::low_precision::InterpolateTransformation
ov::pass::low_precision::LayerTransformation
ov::pass::low_precision::LayerTransformation::Params
ov::pass::low_precision::LayerTransformation::PrecisionDetails
ov::pass::low_precision::MarkupAvgPoolPrecisionPreserved
ov::pass::low_precision::MarkupBias
ov::pass::low_precision::MarkupCanBeQuantized
ov::pass::low_precision::MarkupPrecisions
ov::pass::low_precision::MarkupPrecisions::Restriction
ov::pass::low_precision::MarkupQuantizationGranularity
ov::pass::low_precision::MarkupQuantizationGranularity::PerTensorQuantization
ov::pass::low_precision::MatMulTransformation
ov::pass::low_precision::MaxPoolTransformation
ov::pass::low_precision::MultiplyTransformation
ov::pass::low_precision::MultiplyPartialTransformation
ov::pass::low_precision::MultiplyToGroupConvolutionTransformation
ov::pass::low_precision::MVNTransformation
ov::pass::low_precision::NormalizeL2Transformation
ov::pass::low_precision::PadTransformation
ov::pass::low_precision::PReluTransformation
ov::pass::low_precision::PropagatePrecisions
ov::pass::low_precision::PropagateSharedValue
ov::pass::low_precision::PropagateThroughPrecisionPreserved
ov::pass::low_precision::PropagateToInput
ov::pass::low_precision::PullReshapeThroughDequantization
ov::pass::low_precision::PullTransposeThroughDequantization
ov::pass::low_precision::ReduceBaseTransformation
ov::pass::low_precision::ReduceMaxTransformation
ov::pass::low_precision::ReduceMeanTransformation
ov::pass::low_precision::ReduceMinTransformation
ov::pass::low_precision::ReduceSumTransformation
ov::pass::low_precision::ReluTransformation
ov::pass::low_precision::ReshapeTransformation
ov::AvgPoolPrecisionPreservedAttribute
ov::IntervalsAlignmentSharedValue
ov::IntervalsAlignmentSharedValue::Interval
ov::IntervalsAlignmentAttribute
ov::PrecisionPreservedAttribute
ov::PrecisionsAttribute
ov::QuantizationAlignmentAttribute
ov::QuantizationGranularityAttribute
SharedAttribute::SharedValueAttribute
SharedAttribute::SharedValueAttribute::SharedValue
ov::pass::low_precision::ShuffleChannelsTransformation
ov::pass::low_precision::SpaceToBatchTransformation
ov::pass::low_precision::SplitTransformation
ov::pass::low_precision::SqueezeTransformation
ov::pass::low_precision::StridedSliceTransformation
ov::pass::low_precision::SubtractTransformation
ov::pass::low_precision::TransformationContext
ov::pass::low_precision::TransparentBaseTransformation
ov::pass::low_precision::TransposeTransformation
ov::pass::low_precision::UnsqueezeTransformation
ov::pass::low_precision::UpdateSharedPrecisionPreserved
ov::pass::low_precision::VariadicSplitTransformation
ov::pass::low_precision::WeightableLayerTransformation
ov::pass::low_precision::WeightableLayerTransformation::CanBeTransformedParams
ov::pass::InitMasks
ov::pass::InitConstMask
ov::pass::PropagateMasks
ov::pass::ShrinkWeights
ov::pass::Pruning
ov::pass::AdaptivePoolToReduce
ov::pass::AddFakeQuantizeFusion
ov::pass::AUGRUCellFusion
ov::pass::BatchToSpaceFusion
ov::pass::BinarizeWeights
ov::pass::BroadcastElementwiseFusion
ov::pass::BroadcastTransition
ov::pass::ClampFusion
ov::pass::CompressFloatConstantsImpl
ov::pass::CompressFloatConstants
ov::pass::ConcatFusion
ov::pass::ReplaceConcatReduceByMinOrMax
ov::pass::PullSqueezeThroughEltwise
ov::pass::ConcatReduceFusion
ov::pass::ConvToBinaryConv
ov::pass::ConvertNmsGatherPathToUnsigned
ov::pass::ConvertQuantizeDequantize
ov::pass::ConvertU4WeightsZeroPointToScalar
ov::pass::ConvolutionToGroupConvolutionFusion
ov::pass::DepthToSpaceFusion
ov::pass::DilatedConvolutionConverter
ov::pass::DisableRandomUniformConstantFolding
ov::pass::DivideFusion
ov::pass::DropoutWithRandomUniformReplacer
ov::pass::EliminateUnsqueezeGather
ov::pass::EliminateGatherUnsqueeze
ov::pass::EnableShapeOfConstantFolding
ov::pass::FakeQuantizeMulFusion
ov::pass::FakeQuantizeReshapeFusion
ov::pass::RPE_Fusion
ov::pass::FusedNamesCleanup
ov::pass::GeluFusionWithErfOne
ov::pass::GeluFusionWithErfTwo
ov::pass::GeluFusionWithErfThree
ov::pass::GeluFusionWithErfFour
ov::pass::GeluFusionWithTanh
ov::pass::GeluFusionWithTanhNoPower
ov::pass::GeluFusion
ov::pass::GRUCellFusion
ov::pass::HSigmoidFusionWithReluDiv
ov::pass::HSigmoidFusionWithReluMul
ov::pass::HSigmoidFusionWithoutRelu
ov::pass::HSigmoidFusionWithClampMul
ov::pass::HSigmoidFusionWithClampDiv
ov::pass::HSigmoidFusion
ov::pass::HSwishFusionWithReluDiv
ov::pass::HSwishFusionWithReluMul
ov::pass::HSwishFusionWithHSigmoid
ov::pass::HSwishFusionWithClamp
ov::pass::HSwishFusion
ov::pass::InterpolateSequenceFusion
ov::pass::LeakyReluFusion
ov::pass::LinOpSequenceFusion
ov::pass::LSTMCellFusion
ov::pass::MarkPrecisionSensitiveShapeOfSubgraphs
ov::pass::MarkShapeOfSubgraphs
ov::pass::MarkPrecisionSensitiveConstants
ov::pass::MarkDividesInShapeSubgraphs
ov::pass::MatMulMultiplyFusion
ov::pass::MishFusion
ov::pass::MultiplyConvolutionFusion
ov::pass::MulFakeQuantizeFusion
ov::pass::MVNFusionWithoutConstants
ov::pass::MVNFusionWithConstantsInside
ov::pass::MVNFusion
ov::pass::NearestNeighborUpsamplingFusion
ov::pass::NonZeroHorizontalFusion
ov::pass::EliminatePad
ov::pass::EliminateConvert
ov::pass::EliminateConvertNonZero
ov::pass::EliminateConcat
ov::pass::EliminateSplit
ov::pass::EliminateSqueeze
ov::pass::EliminateTranspose
ov::pass::EliminateEltwise
ov::pass::EliminateScatterUpdate
ov::pass::EliminateSplitConcat
ov::pass::EliminateNopBroadcast
ov::pass::NopSliceBeforeGatherElements
ov::pass::NormalizeL2Fusion
ov::pass::UselessSliceEraser
ov::pass::GroupedStridedSliceOptimizer
ov::pass::GroupedSliceToVSplitOptimization
ov::pass::StridedSliceOptimization
ov::pass::PadFusionAvgPool
ov::pass::PadFusionConvolution
ov::pass::PadFusionConvolutionBackpropData
ov::pass::PadFusionGroupConvolution
ov::pass::PadFusionGroupConvolutionBackpropData
ov::pass::PReluFusionNegativeAdd
ov::pass::PReluFusionNegativeSub
ov::pass::PReluFusionMultiplyAdd
ov::pass::PReluFusionMultiplySub
ov::pass::PReluFusionAbsSubMulMulAdd
ov::pass::PReluFusionNegReluMulAdd
ov::pass::PReluFusion
ov::pass::PullUnsqueezeThroughReduce
ov::pass::PullReshapeThroughReduce
ov::pass::PullThroughReduce
ov::pass::PushConstantToSubgraph
ov::pass::RandomUniformFusion
ov::pass::ReduceMerge
ov::pass::ReduceReshapeFusion
ov::pass::ReluFakeQuantizeFusion
ov::pass::RemoveConcatZeroDimInput
ov::pass::ReshapePRelu
ov::pass::ReshapeSequenceFusion
ov::pass::ReverseInputChannelsFusion
ov::pass::SelectWithOneValueCondition
ov::pass::SequenceFusion
ov::pass::SharedOpOptimization
ov::pass::ShuffleChannelsFusion
ov::pass::GroupedGatherElimination
ov::pass::GatherNopElimination
ov::pass::SkipGatherBeforeTransposeAndReshape
ov::pass::SoftmaxFusion
ov::pass::SoftPlusFusion
ov::pass::SoftPlusToMishFusion
ov::pass::SpaceToBatchFusion
ov::pass::SplitConcatPairToInterpolateFusion
ov::pass::SplitSqueezeConcatFusion
ov::pass::ConvStridesPropagation
ov::pass::SupportedNodesStridesPropagation
ov::pass::UnsupportedNodesStridesPropagation
ov::pass::StridesOptimization
ov::pass::SubtractFusion
ov::pass::SwishFusionWithSigmoid
ov::pass::SwishFusionWithSigmoidWithBeta
ov::pass::SwishFusionWithBeta
ov::pass::SwishFusionWithoutBeta
ov::pass::SwishFusion
ov::pass::TransposeReshapeEliminationForMatmul
ov::pass::TransposeReduction
ov::pass::TransposeFQReduction
ov::pass::TransposeConvert
ov::pass::TransposeEltwise
ov::pass::TransposeFuse
ov::pass::TransposeSinking
ov::pass::TransposeToReshape
ov::pass::WeightsDequantizeToFakeQuantize
ov::pass::WrapInterpolateIntoTransposes
ov::pass::UnrollIf
ov::pass::UnrollTensorIterator
EnumClassHash
ov::pass::AlignMixedFP32FP16Types
ov::pass::ConvertCompressedOnlyToLegacy
ov::pass::EnableDecompressionConvertConstantFolding
ov::pass::DisableDecompressionConvertConstantFolding
ov::pass::KeepConstAndDecompression
ov::pass::KeepConstantsPrecisionAndAddConverts
ov::pass::MarkCompressedFloatConstants
ov::pass::InitNodeInfo
ov::pass::MarkDequantizationSubgraph
ov::pass::BidirectionalLSTMSequenceDecomposition
ov::pass::BidirectionalGRUSequenceDecomposition
ov::pass::BidirectionalRNNSequenceDecomposition
ov::pass::BidirectionalSequenceDecomposition
ov::pass::ConvertBatchToSpace
ConvertBitwiseToLogical
ov::pass::ConvertDeformableConv8To1
ov::pass::ConvertGather0D
ov::pass::ConvertGather7ToGather1
ov::pass::ConvertGather8ToGather7
ov::pass::ConvertGather1ToGather7
ov::pass::ConvertGather7ToGather8
ov::pass::ConvertInterpolate11ToInterpolate4
ov::pass::ConvertInterpolate1ToInterpolate4
ov::pass::ConvertMaxPool8ToMaxPool1
ov::pass::ConvertMaxPool14ToMaxPool8
ov::pass::ConvertMaxPool1ToMaxPool8
ov::pass::ConvertMVN1ToMVN6
ov::pass::ConvertPad12ToPad1
ov::pass::ConvertPadToGroupConvolution
ov::pass::ConvertPriorBox8To0
ov::pass::ConvertROIAlign3To9
ov::pass::ConvertROIAlign9To3
ov::pass::ConvertScatterElementsToScatter
ov::pass::ConvertScatterElementsUpdate12ToScatterElementsUpdate3
ov::pass::ConvertRNNSequenceToTensorIterator
ov::pass::ConvertGRUSequenceToTensorIterator
ov::pass::ConvertLSTMSequenceToTensorIterator
ov::pass::SliceToStridedSlice
ov::pass::ConvertSoftMax8ToSoftMax1
ov::pass::ConvertSoftMax1ToSoftMax8
ov::pass::ConvertSpaceToBatch
ov::pass::ConvertTensorIteratorToLSTMSequence
ov::pass::ConvertTensorIteratorToRNNSequence
ov::pass::ConvertTensorIteratorToGRUSequence
ov::pass::ConvertLoopToLSTMSequence
ov::pass::FuseReverseLSTMSequence
ov::pass::FuseLSTMSequencesToBidirectionalLSTMSequence
ov::pass::ConvertTopK11ToTopK3
ov::pass::ConvertXorToLogicalXor
ov::pass::ConvertDetectionOutput8ToDetectionOutput1
ov::pass::ConvertDetectionOutput1ToDetectionOutput8
ov::pass::EinsumDecomposition
ov::pass::EyeDecomposition
ov::pass::FakeQuantizeDecomposition
ov::pass::Gelu7Downgrade
ov::pass::GRUCellDecomposition
ov::pass::HSigmoidDecomposition
ov::pass::HSwishDecomposition
ov::pass::LogSoftmaxDecomposition
ov::pass::LSTMCellDecomposition
ov::pass::MVN6Decomposition
ov::pass::NormalizeL2Decomposition
ov::pass::ReduceL1Decomposition
ov::pass::ReduceL2Decomposition
ov::pass::RNNCellDecomposition
ov::pass::SoftmaxDecomposition
ov::pass::SoftPlusDecomposition
ov::pass::SoftSignDecomposition
ov::pass::ResolveNameCollisions
ov::pass::BroadcastConstRangeReplacement
ov::pass::LSTMStatesBroadcast
ov::pass::ReshapeAMatMul
ov::pass::Proposal1Scales
ov::pass::ReshapeSinkingMatMul
ov::pass::ReshapeTo1D
ov::pass::ShapeOfConstFolding
ov::pass::StridedSliceSqueeze
ov::pass::SqueezeStridedSlice
ov::pass::ChainedMaximumOptimization
ov::pass::DeReshapeMatMul
ov::pass::DeReshapeFullyConnected
ov::pass::NopBroadcast
ov::pass::ReshapeOptimizations
ov::pass::ApplySymbolEquivalence
ov::pass::OptimizeSymbolsUsedAsValues
ov::pass::SymbolicOptimizations
ov::pass::SymbolicPropagation
ov::pass::LabelResolvingThroughSelect
ov::pass::transpose_sinking::TSForwardBase
ov::pass::transpose_sinking::TSBinaryForward
ov::pass::transpose_sinking::TSBinaryBackward
ov::pass::transpose_sinking::TSConcatForward
ov::pass::transpose_sinking::TSConcatBackward
ov::pass::transpose_sinking::TSCumSumForward
ov::pass::transpose_sinking::TSCumSumBackward
ov::pass::transpose_sinking::TSDataMovementForward
ov::pass::transpose_sinking::TSDataMovementBackward
ov::pass::transpose_sinking::TSFuse
ov::pass::transpose_sinking::TSGatherForward
ov::pass::transpose_sinking::TSGatherBackward
ov::pass::transpose_sinking::TSGeneralForward
ov::pass::transpose_sinking::TSGeneralBackward
ov::pass::transpose_sinking::TSGeneral
ov::pass::transpose_sinking::TSInterpolateForward
ov::pass::transpose_sinking::TSInterpolateBackward
ov::pass::transpose_sinking::TSReductionForward
ov::pass::transpose_sinking::TSReductionBackward
ov::pass::transpose_sinking::TSResetNoSinkingAttribute
ov::pass::transpose_sinking::TSShapeOfForward
ov::pass::transpose_sinking::TSSplitForward
ov::pass::transpose_sinking::TSSplitBackward
ov::pass::transpose_sinking::TSSqueezeForward
ov::pass::transpose_sinking::TSSqueezeBackward
ov::pass::transpose_sinking::TSTileForward
ov::pass::transpose_sinking::TSTileBackward
ov::pass::transpose_sinking::TSUnaryForward
ov::pass::transpose_sinking::TSUnaryBackward
ov::pass::transpose_sinking::TSUnsqueezeForward
ov::pass::transpose_sinking::TSUnsqueezeBackward
Conversion from opset3 to opset2
Conversion from opset2 to opset1
OpenVINO™ Security
Using Encrypted Models with OpenVINO
ABOUT OPENVINO
Performance Benchmarks
Performance Information F.A.Q.
OpenVINO Accuracy
Getting Performance Numbers
Compatibility and Support
Inference Device Support
Supported Operations - by Inference Devices
Supported Operations - by Framework Frontend
Release Notes
System Requirements
Release Policy
Additional Resources
Glossary
Legal Information
OpenVINO™ Telemetry
Case Studies
Class...
Class ov::threading::ThreadSafeQueueWithSize
#
template
<
typename
T
>
class
ThreadSafeQueueWithSize
#
On this page
ThreadSafeQueueWithSize
Download Docs
.pdf
.zip