An internal API of executable network to be implemented by plugin, which is used in ExecutableNetworkBase forwarding mechanism. More...

#include <ie_iexecutable_network_internal.hpp>

Inheritance diagram for InferenceEngine::IExecutableNetworkInternal:

Public Types
typedef std::shared_ptr< IExecutableNetworkInternal >	Ptr
	A shared pointer to IExecutableNetworkInternal interface.

Public Member Functions
virtual	~IExecutableNetworkInternal ()=default
	Destroys the object.

virtual ConstOutputsDataMap	GetOutputsInfo () const =0
	Gets the Executable network output Data node information. The received info is stored in the given Data node. This method need to be called to find output names for using them later during filling of a map of blobs passed later to InferenceEngine::IInferencePlugin::Infer() More...

virtual ConstInputsDataMap	GetInputsInfo () const =0
	Gets the Executable network input Data node information. The received info is stored in the given InputsDataMap object. This method need to be called to find out input names for using them later during filling of a map of blobs passed later to InferenceEngine::IInferencePlugin::Infer() More...

virtual IInferRequest::Ptr	CreateInferRequest ()=0
	Create an inference request object used to infer the network Note: the returned request will have allocated input and output blobs (that can be changed later) More...

virtual void	Export (const std::string &modelFileName)=0
	Export the current created executable network so it can be used later in the Import() main API. More...

virtual void	Export (std::ostream &networkModel)=0
	Export the current created executable network so it can be used later in the Import() main API. More...

virtual CNNNetwork	GetExecGraphInfo ()=0
	Get executable graph information from a device. More...

virtual std::vector< IVariableStateInternal::Ptr >	QueryState ()=0
	Queries memory states. More...

virtual void	SetConfig (const std::map< std::string, Parameter > &config)=0
	Sets configuration for current executable network. More...

virtual Parameter	GetConfig (const std::string &name) const =0
	Gets configuration dedicated to plugin behaviour. More...

virtual Parameter	GetMetric (const std::string &name) const =0
	Gets general runtime metric for dedicated hardware. More...

virtual RemoteContext::Ptr	GetContext () const =0
	Gets the remote context. More...

Detailed Description

An internal API of executable network to be implemented by plugin, which is used in ExecutableNetworkBase forwarding mechanism.

Member Function Documentation

◆ CreateInferRequest()

virtual IInferRequest::Ptr InferenceEngine::IExecutableNetworkInternal::CreateInferRequest ( )

pure virtual

Create an inference request object used to infer the network Note: the returned request will have allocated input and output blobs (that can be changed later)

Returns: shared_ptr for the created request

Implemented in InferenceEngine::ExecutableNetworkThreadSafeDefault, and InferenceEngine::ExecutableNetworkThreadSafeAsyncOnly.

◆ Export() [1/2]

virtual void InferenceEngine::IExecutableNetworkInternal::Export ( const std::string & modelFileName )

pure virtual

Export the current created executable network so it can be used later in the Import() main API.

Deprecated:: Use IExecutableNetworkInternal::Export(std::ostream& networkModel)

Parameters

modelFileName - path to the location of the exported file

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ Export() [2/2]

virtual void InferenceEngine::IExecutableNetworkInternal::Export ( std::ostream & networkModel )

pure virtual

Export the current created executable network so it can be used later in the Import() main API.

Parameters

networkModel - Reference to network model output stream

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ GetConfig()

virtual Parameter InferenceEngine::IExecutableNetworkInternal::GetConfig ( const std::string & name ) const

pure virtual

Gets configuration dedicated to plugin behaviour.

Parameters

name	A config key, can be found in ie_plugin_config.hpp

Returns: A value of config corresponding to config key

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ GetContext()

virtual RemoteContext::Ptr InferenceEngine::IExecutableNetworkInternal::GetContext ( ) const

pure virtual

Gets the remote context.

Returns: A reference to a context

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ GetExecGraphInfo()

virtual CNNNetwork InferenceEngine::IExecutableNetworkInternal::GetExecGraphInfo ( )

pure virtual

Get executable graph information from a device.

Returns: A network object to store executable graph information

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ GetInputsInfo()

virtual ConstInputsDataMap InferenceEngine::IExecutableNetworkInternal::GetInputsInfo ( ) const

pure virtual

Gets the Executable network input Data node information. The received info is stored in the given InputsDataMap object. This method need to be called to find out input names for using them later during filling of a map of blobs passed later to InferenceEngine::IInferencePlugin::Infer()

Returns: inputs Reference to ConstInputsDataMap object.

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ GetMetric()

virtual Parameter InferenceEngine::IExecutableNetworkInternal::GetMetric ( const std::string & name ) const

pure virtual

Gets general runtime metric for dedicated hardware.

Parameters

name	A metric name to request

Returns: A metric value corresponding to metric key

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ GetOutputsInfo()

virtual ConstOutputsDataMap InferenceEngine::IExecutableNetworkInternal::GetOutputsInfo ( ) const

pure virtual

Gets the Executable network output Data node information. The received info is stored in the given Data node. This method need to be called to find output names for using them later during filling of a map of blobs passed later to InferenceEngine::IInferencePlugin::Infer()

Returns: out Reference to the ConstOutputsDataMap object

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ QueryState()

virtual std::vector<IVariableStateInternal::Ptr> InferenceEngine::IExecutableNetworkInternal::QueryState ( )

pure virtual

Queries memory states.

Deprecated:: Need to implement GetVariablesInfo for ExecutableNetwork

Returns: Returns memory states

Implemented in InferenceEngine::ExecutableNetworkInternal.

◆ SetConfig()

virtual void InferenceEngine::IExecutableNetworkInternal::SetConfig ( const std::map< std::string, Parameter > & config )

pure virtual

Sets configuration for current executable network.

Parameters

config Map of pairs: (config parameter name, config parameter value)

Implemented in InferenceEngine::ExecutableNetworkInternal.

The documentation for this interface was generated from the following file:

cpp_interfaces/interface/ie_iexecutable_network_internal.hpp

Public Types

Public Member Functions

Detailed Description

Member Function Documentation

◆ CreateInferRequest()

◆ Export() [1/2]

◆ Export() [2/2]

◆ GetConfig()

◆ GetContext()

◆ GetExecGraphInfo()

◆ GetInputsInfo()

◆ GetMetric()

◆ GetOutputsInfo()

◆ QueryState()

◆ SetConfig()