Inference Engine API Changes History

The sections below contain detailed list of changes made to the Inference Engine API in recent releases.

2021.2

New API

State API

BatchedBlob - represents a InferenceEngine::BatchedBlob containing other blobs - one per batch.

Transformations API - added a new header ie_transformations.hpp which contains transformations for InferenceEngine::CNNNetwork object. Such transformations can be called prior to loading network for compilation for particular device:

  • InferenceEngine::LowLatency

Deprecated API

State API

2021.1

Deprecated API

Utility functions to convert Unicode paths

  • InferenceEngine::stringToFileName - use OS-specific native conversion functions
  • InferenceEngine::fileNameToString - use OS-specific native conversion functions

Removed API

Plugin API:

  • InferenceEngine::InferencePlugin C++ plugin wrapper class
  • InferenceEngine::IInferencePlugin plugin interface
  • InferenceEngine::PluginDispatcher class
  • InferenceEngine::InferenceEnginePluginPtr typedef
  • InferenceEngine::ICNNNetReader reader interface
  • InferenceEngine::CNNNetReader class

Extensibility API:

  • InferenceEngine::ILayerImplFactory class
  • InferenceEngine::IShapeInferImpl class
  • InferenceEngine::IShapeInferExtension class
  • InferenceEngine::IExtension::getFactoryFor(ILayerImplFactory*& factory, const CNNLayer* cnnLayer, ResponseDesc* resp) noexcept method
  • InferenceEngine::IExtension::getPrimitiveTypes(char**& types, unsigned int& size, ResponseDesc* resp) noexcept method
  • InferenceEngine::ShapeInferImpl class
  • InferenceEngine::Extension::getFactoryFor(ILayerImplFactory*& factory, const CNNLayer* cnnLayer, ResponseDesc* resp) noexcept method
  • InferenceEngine::Extension::getPrimitiveTypes(char**& types, unsigned int& size, ResponseDesc* resp) noexcept method

Network API:

  • InferenceEngine::details::CNNNetworkIterator class
  • InferenceEngine::CNNNetwork::getPrecision() const method
  • InferenceEngine::CNNNetwork::getLayerByName(const char* layerName) const method
  • InferenceEngine::CNNNetwork::size() const method
  • InferenceEngine::CNNNetwork::begin() const method
  • InferenceEngine::CNNNetwork::end() const method
  • InferenceEngine::CNNNetwork::AddExtension(const IShapeInferExtensionPtr& extension) method
  • InferenceEngine::ICNNNetwork::getPrecision() const noexcept method
  • InferenceEngine::ICNNNetwork::getName(char* pName, size_t len) const noexcept method
  • InferenceEngine::ICNNNetwork::getData(const char* dname) noexcept method
  • InferenceEngine::ICNNNetwork::addLayer(const CNNLayerPtr& layer) noexcept method
  • InferenceEngine::ICNNNetwork::getLayerByName(const char* layerName, CNNLayerPtr& out, ResponseDesc* resp) const noexcept method
  • InferenceEngine::ICNNNetwork::AddExtension(const IShapeInferExtensionPtr& extension, ResponseDesc* resp) noexcept method
  • InferenceEngine::ICNNNetwork::getStats(ICNNNetworkStats** stats, ResponseDesc* resp) const noexcept method
  • InferenceEngine::ICNNNetworkStats class
  • InferenceEngine::NetworkNodeStats class
  • InferenceEngine::Data::getCreatorLayer() method
  • InferenceEngine::Data::getInputTo() method
  • InferenceEngine::LayerParams class

Layer API:

  • InferenceEngine::CNNLayer class
  • InferenceEngine::WeightableLayer class
  • InferenceEngine::BatchNormalizationLayer class
  • InferenceEngine::BatchToSpaceLayer class
  • InferenceEngine::BinaryConvolutionLayer class
  • InferenceEngine::BroadcastLayer class
  • InferenceEngine::BucketizeLayer class
  • InferenceEngine::ClampLayer class
  • InferenceEngine::ConcatLayer class
  • InferenceEngine::ConvolutionLayer class
  • InferenceEngine::CropLayer class
  • InferenceEngine::DeconvolutionLayer class
  • InferenceEngine::DeformableConvolutionLayer class
  • InferenceEngine::DepthToSpaceLayer class
  • InferenceEngine::EltwiseLayer class
  • InferenceEngine::ExperimentalDetectronPriorGridGenerator class
  • InferenceEngine::ExperimentalDetectronPriorGridGeneratorLayer class
  • InferenceEngine::ExperimentalSparseWeightedReduceLayer class
  • InferenceEngine::FillLayer class
  • InferenceEngine::FullyConnectedLayer class
  • InferenceEngine::GRNLayer class
  • InferenceEngine::GRUCell class
  • InferenceEngine::GatherLayer class
  • InferenceEngine::GemmLayer class
  • InferenceEngine::LSTMCell class
  • InferenceEngine::MVNLayer class
  • InferenceEngine::MathLayer class
  • InferenceEngine::NonMaxSuppression class
  • InferenceEngine::NormLayer class
  • InferenceEngine::OneHotLayer class
  • InferenceEngine::PReLULayer class
  • InferenceEngine::PadLayer class
  • InferenceEngine::PoolingLayer class
  • InferenceEngine::PowerLayer class
  • InferenceEngine::QuantizeLayer class
  • InferenceEngine::RNNCell class
  • InferenceEngine::RNNCellBase class
  • InferenceEngine::RNNSequenceLayer class
  • InferenceEngine::RangeLayer class
  • InferenceEngine::ReLU6Layer class
  • InferenceEngine::ReLULayer class
  • InferenceEngine::ReduceLayer class
  • InferenceEngine::ReshapeLayer class
  • InferenceEngine::ReverseSequenceLayer class
  • InferenceEngine::ScaleShiftLayer class
  • InferenceEngine::ScatterLayer class
  • InferenceEngine::SelectLayer class
  • InferenceEngine::ShuffleChannelsLayer class
  • InferenceEngine::SoftMaxLayer class
  • InferenceEngine::SpaceToBatchLayer class
  • InferenceEngine::SpaceToDepthLayer class
  • InferenceEngine::SparseFillEmptyRowsLayer class
  • InferenceEngine::SparseSegmentReduceLayer class
  • InferenceEngine::SparseToDenseLayer class
  • InferenceEngine::SplitLayer class
  • InferenceEngine::StridedSliceLayer class
  • InferenceEngine::TensorIterator class
  • InferenceEngine::TileLayer class
  • InferenceEngine::TopKLayer class
  • InferenceEngine::UniqueLayer class

2020.4

New API

CPU Plugin API:

Metrics and values for Query API:

Deprecated API

MYRIAD Plugin API:

  • VPU_CONFIG_KEY(IGNORE_IR_STATISTIC)

Removed API

Inference Engine NN Builder API:

  • InferenceEngine::Builder::EltwiseLayer
  • InferenceEngine::Builder::MemoryLayer
  • InferenceEngine::Builder::ROIPoolingLayer
  • InferenceEngine::Builder::DeconvolutionLayer
  • InferenceEngine::Builder::ReLULayer
  • InferenceEngine::Builder::TanHLayer
  • InferenceEngine::Builder::InputLayer
  • InferenceEngine::Builder::PoolingLayer
  • InferenceEngine::Builder::CropLayer
  • InferenceEngine::Builder::GRUSequenceLayer
  • InferenceEngine::Builder::NormLayer
  • InferenceEngine::Builder::LSTMSequenceLayer
  • InferenceEngine::Builder::ClampLayer
  • InferenceEngine::Builder::PSROIPoolingLayer
  • InferenceEngine::Builder::Layer
  • InferenceEngine::Builder::RNNSequenceLayer
  • InferenceEngine::Builder::ReorgYoloLayer
  • InferenceEngine::Builder::NormalizeLayer
  • InferenceEngine::Builder::PriorBoxClusteredLayer
  • InferenceEngine::Builder::MVNLayer
  • InferenceEngine::Builder::PermuteLayer
  • InferenceEngine::Builder::SimplerNMSLayer
  • InferenceEngine::Builder::ConstLayer
  • InferenceEngine::Builder::DeformableConvolutionLayer
  • InferenceEngine::Builder::FullyConnectedLayer
  • InferenceEngine::Builder::PriorBoxLayer
  • InferenceEngine::Builder::SoftMaxLayer
  • InferenceEngine::Builder::OutputLayer
  • InferenceEngine::Builder::TileLayer
  • InferenceEngine::Builder::SplitLayer
  • InferenceEngine::Builder::PReLULayer
  • InferenceEngine::Builder::RegionYoloLayer
  • InferenceEngine::Builder::ReshapeLayer
  • InferenceEngine::Builder::ConvolutionLayer
  • InferenceEngine::Builder::DetectionOutputLayer
  • InferenceEngine::Builder::ConcatLayer
  • InferenceEngine::Builder::ELULayer
  • InferenceEngine::Builder::GRNLayer
  • InferenceEngine::Builder::LRNLayer
  • InferenceEngine::Builder::ArgMaxLayer
  • InferenceEngine::Builder::ReLU6Layer
  • InferenceEngine::Builder::ScaleShiftLayer
  • InferenceEngine::Builder::ProposalLayer
  • InferenceEngine::Builder::SigmoidLayer
  • InferenceEngine::Builder::ResampleLayer
  • InferenceEngine::Builder::CTCGreedyDecoderLayer
  • InferenceEngine::Builder::BatchNormalizationLayer
  • InferenceEngine::Builder::LayerDecorator
  • InferenceEngine::Builder::PowerLayer
  • InferenceEngine::Builder::Network
  • InferenceEngine::Builder::PortInfo
  • InferenceEngine::Builder::Connection
  • InferenceEngine::Builder::PortData
  • InferenceEngine::Builder::Port
  • InferenceEngine::Builder::ILayer
  • InferenceEngine::Builder::INetworkIterator
  • InferenceEngine::Builder::INetwork
  • InferenceEngine::Builder::ILayer

2020.2

New API

Extensibility API:

Deprecated API

Extensibility API:

  • InferenceEngine::ILayerImplFactory class
  • InferenceEngine::IShapeInferImpl class
  • InferenceEngine::IShapeInferImpl class
  • InferenceEngine::IShapeInferExtension class
  • InferenceEngine::IExtension::getFactoryFor(ILayerImplFactory*& factory, const CNNLayer* cnnLayer, ResponseDesc* resp) noexcept method
  • InferenceEngine::IExtension::getPrimitiveTypes(char**& types, unsigned int& size, ResponseDesc* resp) noexcept method
  • InferenceEngine::ShapeInferImpl class
  • InferenceEngine::Extension::getFactoryFor(ILayerImplFactory*& factory, const CNNLayer* cnnLayer, ResponseDesc* resp) noexcept method
  • InferenceEngine::Extension::getPrimitiveTypes(char**& types, unsigned int& size, ResponseDesc* resp) noexcept method

Network API:

  • InferenceEngine::details::CNNNetworkIterator class
  • InferenceEngine::CNNNetwork::getPrecision() const method
  • InferenceEngine::CNNNetwork::getLayerByName(const char* layerName) const method
  • InferenceEngine::CNNNetwork::size() const method
  • InferenceEngine::CNNNetwork::begin() const method
  • InferenceEngine::CNNNetwork::end() const method
  • InferenceEngine::CNNNetwork::AddExtension(const IShapeInferExtensionPtr& extension) method
  • InferenceEngine::ICNNNetwork::getPrecision() const noexcept method
  • InferenceEngine::ICNNNetwork::getName(char* pName, size_t len) const noexcept method
  • InferenceEngine::ICNNNetwork::getData(const char* dname) noexcept method
  • InferenceEngine::ICNNNetwork::addLayer(const CNNLayerPtr& layer) noexcept method
  • InferenceEngine::ICNNNetwork::getLayerByName(const char* layerName, CNNLayerPtr& out, ResponseDesc* resp) const noexcept method
  • InferenceEngine::ICNNNetwork::AddExtension(const IShapeInferExtensionPtr& extension, ResponseDesc* resp) noexcept method
  • InferenceEngine::ICNNNetwork::getStats(ICNNNetworkStats** stats, ResponseDesc* resp) const noexcept method
  • InferenceEngine::ICNNNetworkStats class
  • InferenceEngine::NetworkNodeStats class
  • InferenceEngine::Data::getCreatorLayer() method
  • InferenceEngine::Data::getInputTo() method
  • InferenceEngine::LayerParams class

Layer API:

  • InferenceEngine::CNNLayer class
  • InferenceEngine::WeightableLayer class
  • InferenceEngine::BatchNormalizationLayer class
  • InferenceEngine::BatchToSpaceLayer class
  • InferenceEngine::BinaryConvolutionLayer class
  • InferenceEngine::BroadcastLayer class
  • InferenceEngine::BucketizeLayer class
  • InferenceEngine::ClampLayer class
  • InferenceEngine::ConcatLayer class
  • InferenceEngine::ConvolutionLayer class
  • InferenceEngine::CropLayer class
  • InferenceEngine::DeconvolutionLayer class
  • InferenceEngine::DeformableConvolutionLayer class
  • InferenceEngine::DepthToSpaceLayer class
  • InferenceEngine::EltwiseLayer class
  • InferenceEngine::ExperimentalDetectronPriorGridGenerator class
  • InferenceEngine::ExperimentalDetectronPriorGridGeneratorLayer class
  • InferenceEngine::ExperimentalSparseWeightedReduceLayer class
  • InferenceEngine::FillLayer class
  • InferenceEngine::FullyConnectedLayer class
  • InferenceEngine::GRNLayer class
  • InferenceEngine::GRUCell class
  • InferenceEngine::GatherLayer class
  • InferenceEngine::GemmLayer class
  • InferenceEngine::LSTMCell class
  • InferenceEngine::MVNLayer class
  • InferenceEngine::MathLayer class
  • InferenceEngine::NonMaxSuppression class
  • InferenceEngine::NormLayer class
  • InferenceEngine::OneHotLayer class
  • InferenceEngine::PReLULayer class
  • InferenceEngine::PadLayer class
  • InferenceEngine::PoolingLayer class
  • InferenceEngine::PowerLayer class
  • InferenceEngine::QuantizeLayer class
  • InferenceEngine::RNNCell class
  • InferenceEngine::RNNCellBase class
  • InferenceEngine::RNNSequenceLayer class
  • InferenceEngine::RangeLayer class
  • InferenceEngine::ReLU6Layer class
  • InferenceEngine::ReLULayer class
  • InferenceEngine::ReduceLayer class
  • InferenceEngine::ReshapeLayer class
  • InferenceEngine::ReverseSequenceLayer class
  • InferenceEngine::ScaleShiftLayer class
  • InferenceEngine::ScatterLayer class
  • InferenceEngine::SelectLayer class
  • InferenceEngine::ShuffleChannelsLayer class
  • InferenceEngine::SoftMaxLayer class
  • InferenceEngine::SpaceToBatchLayer class
  • InferenceEngine::SpaceToDepthLayer class
  • InferenceEngine::SparseFillEmptyRowsLayer class
  • InferenceEngine::SparseSegmentReduceLayer class
  • InferenceEngine::SparseToDenseLayer class
  • InferenceEngine::SplitLayer class
  • InferenceEngine::StridedSliceLayer class
  • InferenceEngine::TensorIterator class
  • InferenceEngine::TileLayer class
  • InferenceEngine::TopKLayer class
  • InferenceEngine::UniqueLayer class

2020.1

New API

Integration with ngraph API:

Offline compilation: import / export to std::stream:

RemoteBlob accelerator memory sharing API:

GNA firmware model image generation:

MemoryBlob mapping of memory to the user space:

Memory interoperability on acceleration devices. General classes and GPU helper functions

  • InferenceEngine::RemoteBlob class
  • InferenceEngine::RemoteContext class
  • InferenceEngine::Core::CreateContext(const std::string& deviceName, const ParamMap& params) method
  • InferenceEngine::Core::GetDefaultContext(const std::string& deviceName) method
  • InferenceEngine::make_shared_blob(const TensorDesc& desc, RemoteContext::Ptr ctx) function
  • InferenceEngine::gpu::make_shared_blob_nv12(size_t height, size_t width, RemoteContext::Ptr ctx, VASurfaceID nv12_surf) function
  • InferenceEngine::gpu::make_shared_context(Core& core, std::string deviceName, VADisplay device) function
  • InferenceEngine::gpu::make_shared_blob(const TensorDesc& desc, RemoteContext::Ptr ctx, VASurfaceID surface, uint32_t plane = 0) function
  • InferenceEngine::gpu::make_shared_blob_nv12(RemoteContext::Ptr ctx, cl::Image2D& nv12_image_plane_y, cl::Image2D& nv12_image_plane_uv) function
  • InferenceEngine::gpu::make_shared_context(Core& core, std::string deviceName, cl_context ctx) function
  • InferenceEngine::gpu::make_shared_blob(const TensorDesc& desc, ClContext::Ptr ctx) function
  • InferenceEngine::gpu::make_shared_blob(const TensorDesc& desc, RemoteContext::Ptr ctx, cl::Buffer& buffer) function
  • InferenceEngine::gpu::make_shared_blob(const TensorDesc& desc, RemoteContext::Ptr ctx, cl_mem buffer) function
  • InferenceEngine::gpu::make_shared_blob(const TensorDesc& desc, RemoteContext::Ptr ctx, cl::Image2D& image) function

Deprecated API

Inference Engine NN Builder API:

  • InferenceEngine::Builder::EltwiseLayer
  • InferenceEngine::Builder::MemoryLayer
  • InferenceEngine::Builder::ROIPoolingLayer
  • InferenceEngine::Builder::DeconvolutionLayer
  • InferenceEngine::Builder::ReLULayer
  • InferenceEngine::Builder::TanHLayer
  • InferenceEngine::Builder::InputLayer
  • InferenceEngine::Builder::PoolingLayer
  • InferenceEngine::Builder::CropLayer
  • InferenceEngine::Builder::GRUSequenceLayer
  • InferenceEngine::Builder::NormLayer
  • InferenceEngine::Builder::LSTMSequenceLayer
  • InferenceEngine::Builder::ClampLayer
  • InferenceEngine::Builder::PSROIPoolingLayer
  • InferenceEngine::Builder::Layer
  • InferenceEngine::Builder::RNNSequenceLayer
  • InferenceEngine::Builder::ReorgYoloLayer
  • InferenceEngine::Builder::NormalizeLayer
  • InferenceEngine::Builder::PriorBoxClusteredLayer
  • InferenceEngine::Builder::MVNLayer
  • InferenceEngine::Builder::PermuteLayer
  • InferenceEngine::Builder::SimplerNMSLayer
  • InferenceEngine::Builder::ConstLayer
  • InferenceEngine::Builder::DeformableConvolutionLayer
  • InferenceEngine::Builder::FullyConnectedLayer
  • InferenceEngine::Builder::PriorBoxLayer
  • InferenceEngine::Builder::SoftMaxLayer
  • InferenceEngine::Builder::OutputLayer
  • InferenceEngine::Builder::TileLayer
  • InferenceEngine::Builder::SplitLayer
  • InferenceEngine::Builder::PReLULayer
  • InferenceEngine::Builder::RegionYoloLayer
  • InferenceEngine::Builder::ReshapeLayer
  • InferenceEngine::Builder::ConvolutionLayer
  • InferenceEngine::Builder::DetectionOutputLayer
  • InferenceEngine::Builder::ConcatLayer
  • InferenceEngine::Builder::ELULayer
  • InferenceEngine::Builder::GRNLayer
  • InferenceEngine::Builder::LRNLayer
  • InferenceEngine::Builder::ArgMaxLayer
  • InferenceEngine::Builder::ReLU6Layer
  • InferenceEngine::Builder::ScaleShiftLayer
  • InferenceEngine::Builder::ProposalLayer
  • InferenceEngine::Builder::SigmoidLayer
  • InferenceEngine::Builder::ResampleLayer
  • InferenceEngine::Builder::CTCGreedyDecoderLayer
  • InferenceEngine::Builder::BatchNormalizationLayer
  • InferenceEngine::Builder::LayerDecorator
  • InferenceEngine::Builder::PowerLayer
  • InferenceEngine::Builder::Network
  • InferenceEngine::Builder::PortInfo
  • InferenceEngine::Builder::Connection
  • InferenceEngine::Builder::PortData
  • InferenceEngine::Builder::Port
  • InferenceEngine::Builder::ILayer
  • InferenceEngine::Builder::INetworkIterator
  • InferenceEngine::Builder::INetwork
  • InferenceEngine::Builder::ILayer

Plugin API:

  • InferenceEngine::InferencePlugin C++ plugin wrapper class
  • InferenceEngine::IInferencePlugin plugin interface
  • InferenceEngine::PluginDispatcher class
  • InferenceEngine::InferenceEnginePluginPtr typedef
  • InferenceEngine::ICNNNetReader reader interface
  • InferenceEngine::CNNNetReader class

Blob API:

  • Blob::element_size() const noexcept method
  • Blob::buffer() noexcept method
  • Blob::cbuffer() noexcept method
  • MemoryBlob::buffer() noexcept method
  • MemoryBlob::cbuffer() noexcept method

Removed API

Removed all Inference Engine API which deprecated in 2019'R2

2019 R3

New API

New supported layers:

  • InferenceEngine::SparseFillEmptyRowsLayer new class
  • InferenceEngine::UniqueLayer new class
  • InferenceEngine::NonMaxSuppressionLayer new class
  • InferenceEngine::ScatterLayer new class

FPGA plugin streaming support:

Removed API

  • InferenceEngine::EltwiseLayer::Select from InferenceEngine::EltwiseLayer::eOperation enumeration

2019 R2

New API

Inference Engine Core API:

Query API extensions to InferenceEngine::ExecutableNetwork and InferenceEngine::IExecutableNetwork:

Metrics and values for Query API:

Common API:

New supported primitives:

  • InferenceEngine::Builder::DeformableConvolutionLayer new class
  • InferenceEngine::DeformableConvolutionLayer new class
  • InferenceEngine::EltwiseLayer::Logical_NOT, InferenceEngine::EltwiseLayer::Mean, InferenceEngine::EltwiseLayer::Select extensions to InferenceEngine::EltwiseLayer::eOperation enumeration
  • InferenceEngine::OneHotLayer new class
  • InferenceEngine::SelectLayer new class
  • InferenceEngine::BroadcastLayer new class
  • InferenceEngine::MathLayer new class
  • InferenceEngine::ReduceLayer new class
  • InferenceEngine::TopKLayer new class

Extensions to Blob creation API:

Deprecated API

The methods listed below are deprecated and will be removed in 2019 R4 release:

Common API:

  • InferenceEngine::InputInfo::getInputPrecision method
  • InferenceEngine::InputInfo::setInputPrecision method
  • InferenceEngine::InputInfo::getDims method
  • InferenceEngine::CNNLayer::GetParamsAsBool method
  • InferenceEngine::CNNNetwork::CNNNetwork(ICNNNetwork* actual) constructor
  • InferenceEngine::CNNNetwork::setTargetDevice method
  • HETERO_CONFIG_KEY(DUMP_DLA_MESSAGES) config key
  • InferenceEngine::ILayerImplFactory::getShapes method
  • InferenceEngine::IShapeInferImpl::inferShapes(const std::vector<SizeVector>&, const std::map<std::string, std::string>& , const std::map<std::string, Blob::Ptr>&, std::vector<SizeVector>&, ResponseDesc*) method
  • InferenceEngine::Data::setBatchSize method
  • InferenceEngine::QueryNetworkResult::supportedLayers field
  • InferenceEngine::ICNNNetwork::setBatchSize(const size_t size) method
  • InferenceEngine::Blob::Resize method
  • InferenceEngine::Blob::Reshape method
  • InferenceEngine::TBlob::set method

InferenceEngine::IInferencePlugin and InferenceEngine:InferencePlugin obsolete methods:

  • InferenceEngine::InferencePlugin::LoadNetwork(ICNNNetwork &network) method
  • InferenceEngine::InferencePlugin::Infer method
  • InferenceEngine::InferencePlugin::GetPerformanceCounts method
  • InferenceEngine::InferencePlugin::QueryNetwork(const ICNNNetwork &network, QueryNetworkResult &res) const method
  • InferenceEngine::IInferencePlugin::LoadNetwork(ICNNNetwork &network, ResponseDesc *resp) method
  • InferenceEngine::IInferencePlugin::Infer(const Blob &input, Blob &result, ResponseDesc *resp) method
  • InferenceEngine::IInferencePlugin::Infer(const BlobMap &input, BlobMap &result, ResponseDesc *resp) method
  • InferenceEngine::IInferencePlugin::GetPerformanceCounts method
  • InferenceEngine::IInferencePlugin::QueryNetwork(const ICNNNetwork& network, QueryNetworkResult& res) const method

Fields in InferenceEngine::Data class are replaced with appropriate methods:

  • InferenceEngine::Data::precision field
  • InferenceEngine::Data::layout field
  • InferenceEngine::Data::dims field
  • InferenceEngine::Data::creatorLayer field
  • InferenceEngine::Data::name field
  • InferenceEngine::Data::inputTo field
  • InferenceEngine::Data::userObject field

Heterogeneous plugin:

  • InferenceEngine::IHeteroDeviceLoader class
  • InferenceEngine::IHeteroInferencePlugin class
  • InferenceEngine::HeteroPluginPtr class
  • operator InferenceEngine::InferencePlugin::HeteroPluginPtr operator

Blob creation API with dimensions in reverse order:

  • InferenceEngine::Blob::Blob(Precision p) constructor
  • InferenceEngine::Blob::Blob(Precision p, Layout l) constructor
  • InferenceEngine::Blob::Blob(Precision p, const SizeVector &dims) constructor
  • InferenceEngine::Blob::Blob(Precision p, Layout l, const SizeVector &dims) constructor
  • InferenceEngine::TBlob::TBlob(Precision p, Layout l) constructor
  • InferenceEngine::TBlob::TBlob(Precision p, Layout l, const SizeVector& dims) constructor
  • InferenceEngine::TBlob::TBlob(Precision p, Layout l, const SizeVector& dims, T* ptr, size_t data_size) constructor
  • InferenceEngine::TBlob::TBlob(Precision p, Layout l, const SizeVector &dims, std::shared_ptr<IAllocator> alloc) constructor
  • InferenceEngine::Blob::type() method
  • InferenceEngine::Blob::precision() method
  • InferenceEngine::Blob::layout() method
  • InferenceEngine::Blob::dims() method
  • InferenceEngine::make_shared_blob(Precision p, Layout l, const SizeVector &dims) function
  • InferenceEngine::make_shared_blob(Precision p, const SizeVector &dims) function
  • InferenceEngine::make_shared_blob(Precision p, Layout l, const TArg &arg) function
  • InferenceEngine::make_shared_blob(Precision p, const TArg &arg) function
  • InferenceEngine::make_shared_blob(TBlob<TypeTo> &&arg) function
  • InferenceEngine::make_shared_blob(Precision p, Layout l) function
  • InferenceEngine::make_shared_blob(Precision p, Layout l, SizeVector dims, const std::vector<TypeTo> &arg) function
  • InferenceEngine::make_shared_blob(Precision p, Layout l, const std::vector<TypeTo> &arg) function
  • InferenceEngine::make_shared_blob(Precision p, const std::vector<TypeTo> &arg) function
  • InferenceEngine::make_shared_blob(Precision p, Layout l, const SizeVector &dims, TypeTo * ptr, size_t size) function
  • InferenceEngine::make_shared_blob(Precision p, const SizeVector &dims, TypeTo * ptr, size_t size) function
  • InferenceEngine::I_N variable
  • InferenceEngine::I_C variable
  • InferenceEngine::I_H variable
  • InferenceEngine::I_W variable
  • InferenceEngine::LayoutOffsetCounter class
  • InferenceEngine::ConvertLayout function

API working with device enumeration:

  • InferenceEngine::TargetDevice enumeration
  • InferenceEngine::TargetDeviceInfo class
  • InferenceEngine::getDeviceName function
  • InferenceEngine::FindPluginRequest class
  • InferenceEngine::FindPluginResponse class
  • InferenceEngine::findPlugin(const FindPluginRequest &req, FindPluginResponse &result, ResponseDesc *resp) function
  • InferenceEngine::ICNNNetwork::setTargetDevice method
  • InferenceEngine::ICNNNetwork::getTargetDevice method
  • InferenceEngine::PluginDispatcher::getPluginByDevice method
  • InferenceEngine::PluginDispatcher::getSuitablePlugin method