Struct ov::threading::IStreamsExecutor::Config#

struct Config#

Defines IStreamsExecutor configuration.

Public Types

enum class StreamsMode#

This enum contains definition of each sub streams mode, indicating the main stream situation.

Values:

enumerator SUB_STREAMS_NULL#

Do not create sub streams.

enumerator SUB_STREAMS_FOR_SOCKET#

Create sub streams for multiple sockets in main stream.

enumerator LATENCY#

latency mode

enumerator THROUGHPUT#

throughput mode

Public Functions

inline Config(std::string name = "StreamsExecutor", int streams = 1, int threads_per_stream = 0, ov::hint::SchedulingCoreType thread_preferred_core_type = ov::hint::SchedulingCoreType::ANY_CORE, bool cpu_reservation = false, bool cpu_pinning = false, std::vector<std::vector<int>> streams_info_table = {}, std::vector<int> rank = {})#

A constructor with arguments.

Parameters:

  • name – [in] The executor name

  • streams – [in]

  • threads_per_stream – [in]

  • thread_preferred_core_type – [in]

  • cpu_reservation – [in]

  • cpu_pinning – [in]

  • streams_info_table – [in]

  • rank – [in]

void set_property(const ov::AnyMap &properties)#

Sets configuration.

Parameters:

properties – map of properties

void set_property(const std::string &key, const ov::Any &value)#

Sets configuration.

Parameters:

  • key – property name

  • value – property value

ov::Any get_property(const std::string &key) const#

Return configuration value.

Parameters:

key – configuration key

Returns:

configuration value wrapped into ov::Any

Public Static Functions

static Config make_default_multi_threaded(const Config &initial)#

Create appropriate multithreaded configuration filing unconfigured values from initial configuration using hardware properties.

Parameters:

initial – Inital configuration

Returns:

configured values