An internal API of executable network to be implemented by plugin,. More...

#include <ie_iexecutable_network_internal.hpp>

Inheritance diagram for InferenceEngine::IExecutableNetworkInternal:

Public Types
using	Ptr = std::shared_ptr< IExecutableNetworkInternal >
	A shared pointer to IExecutableNetworkInternal interface.

Public Member Functions
virtual void	setNetworkInputs (const InputsDataMap &networkInputs)
	Sets the network inputs info. More...

virtual void	setNetworkOutputs (const OutputsDataMap &networkOutputs)
	Sets the network outputs data. More...

virtual ConstOutputsDataMap	GetOutputsInfo () const
	Gets the Executable network output Data node information. The received info is stored in the given Data node. More...

virtual ConstInputsDataMap	GetInputsInfo () const
	Gets the Executable network input Data node information. The received info is stored in the given InputsDataMap object. More...

virtual std::shared_ptr< IInferRequestInternal >	CreateInferRequest ()
	Create an inference request object used to infer the network Note: the returned request will have allocated input and output blobs (that can be changed later) More...

virtual void	Export (const std::string &modelFileName)
	Export the current created executable network so it can be used later in the Import() main API. More...

virtual void	Export (std::ostream &networkModel)
	Export the current created executable network so it can be used later in the Import() main API. More...

virtual CNNNetwork	GetExecGraphInfo ()
	Get executable graph information from a device. More...

virtual std::vector< std::shared_ptr< IVariableStateInternal > >	QueryState ()
	Queries memory states. More...

virtual void	SetPointerToPlugin (const std::shared_ptr< IInferencePlugin > &plugin)
	Sets the pointer to plugin internal. More...

virtual void	SetConfig (const std::map< std::string, Parameter > &config)
	Sets configuration for current executable network. More...

virtual Parameter	GetConfig (const std::string &name) const
	Gets configuration dedicated to plugin behaviour. More...

virtual Parameter	GetMetric (const std::string &name) const
	Gets general runtime metric for dedicated hardware. More...

virtual std::shared_ptr< RemoteContext >	GetContext () const
	Gets the remote context. More...

Protected Member Functions
virtual std::shared_ptr< IInferRequestInternal >	CreateInferRequestImpl (InputsDataMap networkInputs, OutputsDataMap networkOutputs)
	Creates an inference request internal implementation. More...

Protected Attributes
InferenceEngine::InputsDataMap	_networkInputs
	Holds information about network inputs info.

InferenceEngine::OutputsDataMap	_networkOutputs
	Holds information about network outputs data.

std::shared_ptr< IInferencePlugin >	_plugin
	A pointer to a IInferencePlugin interface. More...

Detailed Description

An internal API of executable network to be implemented by plugin,.

Member Function Documentation

◆ CreateInferRequest()

virtual std::shared_ptr<IInferRequestInternal> InferenceEngine::IExecutableNetworkInternal::CreateInferRequest ( )

virtual

Create an inference request object used to infer the network Note: the returned request will have allocated input and output blobs (that can be changed later)

Returns: shared_ptr for the created request

Implemented in InferenceEngine::ExecutableNetworkThreadSafeDefault.

◆ CreateInferRequestImpl()

virtual std::shared_ptr<IInferRequestInternal> InferenceEngine::IExecutableNetworkInternal::CreateInferRequestImpl	(	InputsDataMap	networkInputs,
		OutputsDataMap	networkOutputs
	)

protectedvirtual

Creates an inference request internal implementation.

Note: The method is called by IExecutableNetworkInternal::CreateInferRequest as plugin-specific implementation.

Parameters

[in]	networkInputs	The network inputs
[in]	networkOutputs	The network outputs

Returns: A shared pointer to inference request object.

◆ Export() [1/2]

virtual void InferenceEngine::IExecutableNetworkInternal::Export ( const std::string & modelFileName )

virtual

Export the current created executable network so it can be used later in the Import() main API.

Deprecated:: Use IExecutableNetworkInternal::Export(std::ostream& networkModel)

Parameters

modelFileName - path to the location of the exported file

◆ Export() [2/2]

virtual void InferenceEngine::IExecutableNetworkInternal::Export ( std::ostream & networkModel )

virtual

Export the current created executable network so it can be used later in the Import() main API.

Parameters

networkModel - Reference to network model output stream

◆ GetConfig()

virtual Parameter InferenceEngine::IExecutableNetworkInternal::GetConfig ( const std::string & name ) const

virtual

Gets configuration dedicated to plugin behaviour.

Parameters

name	A config key, can be found in ie_plugin_config.hpp

Returns: A value of config corresponding to config key

◆ GetContext()

virtual std::shared_ptr<RemoteContext> InferenceEngine::IExecutableNetworkInternal::GetContext ( ) const

virtual

Gets the remote context.

Returns: A reference to a context

◆ GetExecGraphInfo()

virtual CNNNetwork InferenceEngine::IExecutableNetworkInternal::GetExecGraphInfo ( )

virtual

Get executable graph information from a device.

Returns: A network object to store executable graph information

◆ GetInputsInfo()

virtual ConstInputsDataMap InferenceEngine::IExecutableNetworkInternal::GetInputsInfo ( ) const

virtual

Gets the Executable network input Data node information. The received info is stored in the given InputsDataMap object.

Returns: inputs Reference to ConstInputsDataMap object.

◆ GetMetric()

virtual Parameter InferenceEngine::IExecutableNetworkInternal::GetMetric ( const std::string & name ) const

virtual

Gets general runtime metric for dedicated hardware.

Parameters

name	A metric name to request

Returns: A metric value corresponding to metric key

◆ GetOutputsInfo()

virtual ConstOutputsDataMap InferenceEngine::IExecutableNetworkInternal::GetOutputsInfo ( ) const

virtual

Gets the Executable network output Data node information. The received info is stored in the given Data node.

Returns: out Reference to the ConstOutputsDataMap object

◆ QueryState()

virtual std::vector<std::shared_ptr<IVariableStateInternal> > InferenceEngine::IExecutableNetworkInternal::QueryState ( )

virtual

Queries memory states.

Deprecated:: Need to implement GetVariablesInfo for ExecutableNetwork

Returns: Returns memory states

◆ SetConfig()

virtual void InferenceEngine::IExecutableNetworkInternal::SetConfig ( const std::map< std::string, Parameter > & config )

virtual

Sets configuration for current executable network.

Parameters

config Map of pairs: (config parameter name, config parameter value)

◆ setNetworkInputs()

virtual void InferenceEngine::IExecutableNetworkInternal::setNetworkInputs ( const InputsDataMap & networkInputs )

virtual

Sets the network inputs info.

Parameters

[in] networkInputs The network inputs info

◆ setNetworkOutputs()

virtual void InferenceEngine::IExecutableNetworkInternal::setNetworkOutputs ( const OutputsDataMap & networkOutputs )

virtual

Sets the network outputs data.

Parameters

[in] networkOutputs The network outputs

◆ SetPointerToPlugin()

virtual void InferenceEngine::IExecutableNetworkInternal::SetPointerToPlugin ( const std::shared_ptr< IInferencePlugin > & plugin )

virtual

Sets the pointer to plugin internal.

Parameters

[in] plugin The plugin

Note: Needed to correctly handle ownership between objects.

Field Documentation

◆ _plugin

std::shared_ptr<IInferencePlugin> InferenceEngine::IExecutableNetworkInternal::_plugin

protected

A pointer to a IInferencePlugin interface.

Note: Needed to correctly handle ownership between objects.

The documentation for this interface was generated from the following file:

cpp_interfaces/interface/ie_iexecutable_network_internal.hpp

Public Types

Public Member Functions

Protected Member Functions

Protected Attributes

Detailed Description

Member Function Documentation

◆ CreateInferRequest()

◆ CreateInferRequestImpl()

◆ Export() [1/2]

◆ Export() [2/2]

◆ GetConfig()

◆ GetContext()

◆ GetExecGraphInfo()

◆ GetInputsInfo()

◆ GetMetric()

◆ GetOutputsInfo()

◆ QueryState()

◆ SetConfig()

◆ setNetworkInputs()

◆ setNetworkOutputs()

◆ SetPointerToPlugin()

Field Documentation

◆ _plugin