Struct ov::threading::IStreamsExecutor::Config#

struct Config

Defines IStreamsExecutor configuration.

Public Types

enum class StreamsMode

This enum contains definition of each sub streams mode, indicating the main stream situation.

Values:

enumerator SUB_STREAMS_NULL

Do not create sub streams.

enumerator SUB_STREAMS_FOR_SOCKET

Create sub streams for multiple sockets in main stream.

enumerator LATENCY

latency mode

enumerator THROUGHPUT

throughput mode

Public Functions

inline Config(std::string name = "StreamsExecutor", int streams = 1, int threads_per_stream = 0, ov::hint::SchedulingCoreType thread_preferred_core_type = ov::hint::SchedulingCoreType::ANY_CORE, bool cpu_reservation = false, bool cpu_pinning = false, std::vector<std::vector<int>> streams_info_table = {})

A constructor with arguments.

Parameters:

  • name – [in] The executor name

  • streams – [in]

  • threads_per_stream – [in]

  • thread_preferred_core_type – [in]

  • cpu_reservation – [in]

  • cpu_pinning – [in]

  • streams_info_table – [in]

void set_property(const ov::AnyMap &properties)

Sets configuration.

Parameters:

properties – map of properties

void set_property(const std::string &key, const ov::Any &value)

Sets configuration.

Parameters:

  • key – property name

  • value – property value

ov::Any get_property(const std::string &key) const

Return configuration value.

Parameters:

key – configuration key

Returns:

configuration value wrapped into ov::Any

Public Static Functions

static Config make_default_multi_threaded(const Config &initial)

Create appropriate multithreaded configuration filing unconfigured values from initial configuration using hardware properties.

Parameters:

initial – Inital configuration

Returns:

configured values