class ov::IRemoteContext

Overview

#include <iremote_context.hpp>

class IRemoteContext: public std::enable_shared_from_this< IRemoteContext >
{
public:
    // methods

    virtual const ov::AnyMap& get_property() const = 0;

    virtual std::shared_ptr<ov::IRemoteTensor> create_tensor(
        const ov::element::Type& type,
        const ov::Shape& shape,
        const ov::AnyMap& params = {}
        ) = 0;

    virtual std::shared_ptr<ov::ITensor> create_host_tensor(
        const ov::element::Type type,
        const ov::Shape& shape
        );
};

Detailed Documentation

Methods

virtual const ov::AnyMap& get_property() const = 0

Returns a map of device-specific parameters required for low-level operations with underlying object. Parameters include device/context handles, access flags, etc. Contents of the map returned depend on remote execution context that is currently set on the device (working scenario). Abstract method.

Returns:

A map of name/Any elements.

virtual std::shared_ptr<ov::IRemoteTensor> create_tensor(
    const ov::element::Type& type,
    const ov::Shape& shape,
    const ov::AnyMap& params = {}
    ) = 0

Allocates memory tensor in device memory or wraps user-supplied memory handle using the specified tensor description and low-level device-specific parameters. Returns a pointer to the object that implements the RemoteTensor interface.

Parameters:

type	Defines the element type of the tensor.
shape	Defines the shape of the tensor.
params	Map of the low-level tensor object parameters.

Returns:

Pointer to a plugin object that implements the RemoteTensor interface.

virtual std::shared_ptr<ov::ITensor> create_host_tensor(
    const ov::element::Type type,
    const ov::Shape& shape
    )

This method is used to create a host tensor object friendly for the device in current context. For example, GPU context may allocate USM host memory (if corresponding extension is available), which could be more efficient than regular host memory.

Parameters:

type	Tensor element type.
shape	Tensor shape.

Returns:

A tensor instance with device friendly memory.