openvino.runtime

openvino module namespace, exposing factory functions for all ops and other classes.

Functions

compile_model(model[, device_name, config])

Compact method to compile model with AUTO plugin.

get_batch(arg0)

get_version()

save_model(model, output_model, compress_to_fp16)

Save model into IR files (xml and bin).

serialize(model, xml_path, bin_path, version)

Serialize given model into IR. The generated .xml and .bin files will be saved into provided paths. This method serializes model "as-is" that means no weights compression is applied. It is recommended to use ov::save_model function instead of ov::serialize in all cases when it is not related to debugging. :param model: model which will be converted to IR representation :type model: openvino.runtime.Model :param xml_path: path where .xml file will be saved :type xml_path: Union[str, bytes, pathlib.Path] :param bin_path: path where .bin file will be saved (optional), the same name as for xml_path will be used by default. :type bin_path: Union[str, bytes, pathlib.Path] :param version: version of the generated IR (optional). Supported versions are: - "UNSPECIFIED" (default) : Use the latest or model version - "IR_V10" : v10 IR - "IR_V11" : v11 IR.

set_batch(*args, **kwargs)

Overloaded function.

shutdown()

Shut down the OpenVINO by deleting all static-duration objects allocated by the library and releasing dependent resources

tensor_from_file(path)

Create Tensor from file.

Classes

AsyncInferQueue

AsyncInferQueue with a pool of asynchronous requests.

AxisSet

openvino.runtime.AxisSet wraps ov::AxisSet

AxisVector

openvino.runtime.AxisVector wraps ov::AxisVector

CompiledModel(other)

CompiledModel class.

ConstOutput

openvino.runtime.ConstOutput represents port/node output.

Coordinate

openvino.runtime.Coordinate wraps ov::Coordinate

CoordinateDiff

openvino.runtime.CoordinateDiff wraps ov::CoordinateDiff

Core

Core class represents OpenVINO runtime Core entity.

Dimension

openvino.runtime.Dimension wraps ov::Dimension

DiscreteTypeInfo

openvino.runtime.DiscreteTypeInfo wraps ov::DiscreteTypeInfo

Extension

openvino.runtime.Extension provides the base interface for OpenVINO extensions.

InferRequest(other)

InferRequest class represents infer request which can be run in asynchronous or synchronous manners.

Input

openvino.runtime.Input wraps ov::Input<Node>

Layout

openvino.runtime.Layout wraps ov::Layout

Model(*args, **kwargs)

Node

openvino.runtime.Node wraps ov::Node

OVAny

openvino.runtime.OVAny provides object wrapper for OpenVINOov::Any class.

Output

openvino.runtime.Output represents port/node output.

PartialShape

openvino.runtime.PartialShape wraps ov::PartialShape

ProfilingInfo

openvino.runtime.ProfilingInfo contains performance metrics for single node.

RTMap

openvino.runtime.RTMap makes bindings for std::map<std::string, ov::Any>, which can later be used as ov::Node::RTMap

Shape

openvino.runtime.Shape wraps ov::Shape

Strides

openvino.runtime.Strides wraps ov::Strides

Tensor

openvino.runtime.Tensor holding either copy of memory or shared host memory.

Type

openvino.runtime.Type wraps ov::element::Type

Version

openvino.runtime.Version represents version information that describes plugins and the OpenVINO library.