class ov::threading::CPUStreamsExecutor¶
Overview¶
CPU Streams executor implementation. The executor splits the CPU into groups of threads, that can be pinned to cores or NUMA nodes. It uses custom threads to pull tasks from single queue. More…
#include <cpu_streams_executor.hpp>
class CPUStreamsExecutor: public ov::threading::IStreamsExecutor
{
public:
// construction
CPUStreamsExecutor();
// methods
virtual voidTask run();
virtual voidTask execute();
virtual int get_stream_id();
virtual int get_numa_node_id();
virtual int get_socket_id();
};Inherited Members¶
public:
// enums
enum ThreadBindingType;
// structs
struct Config;
// methods
virtual voidTask run() = 0;
virtual voidconst std::vector<Task>& run_and_wait();
virtual int get_stream_id() = 0;
virtual int get_numa_node_id() = 0;
virtual int get_socket_id() = 0;
virtual voidTask execute() = 0;Detailed Documentation¶
CPU Streams executor implementation. The executor splits the CPU into groups of threads, that can be pinned to cores or NUMA nodes. It uses custom threads to pull tasks from single queue.
Methods¶
virtual voidTask run()Execute ov::Task inside task executor context.
Parameters:
task |
A task to start |
virtual voidTask execute()Execute the task in the current thread using streams executor configuration and constraints.
Parameters:
task |
A task to start |
virtual int get_stream_id()Return the index of current stream.
Returns:
An index of current stream. Or throw exceptions if called not from stream thread
virtual int get_numa_node_id()Return the id of current NUMA Node Return 0 when current stream cross some NUMA Nodes.
Returns:
ID of current NUMA Node, or throws exceptions if called not from stream thread
virtual int get_socket_id()Return the id of current socket Return 0 when current stream cross some sockets.
Returns:
ID of current socket, or throws exceptions if called not from stream thread