A header file for Executor Manager. More...
#include <string>#include <unordered_map>#include <vector>#include <utility>#include <mutex>#include "threading/ie_itask_executor.hpp"#include "threading/ie_istreams_executor.hpp"Go to the source code of this file.
Data Structures | |
| class | InferenceEngine::ExecutorManager |
| This is global point for getting task executor objects by string id. It's necessary in multiple asynchronous requests for having unique executors to avoid oversubscription. E.g. There 2 task executors for CPU device: one - in FPGA, another - in MKLDNN. Parallel execution both of them leads to not optimal CPU usage. More efficient to run the corresponding tasks one by one via single executor. More... | |
Namespaces | |
| InferenceEngine | |
| Inference Engine Plugin API namespace. | |
A header file for Executor Manager.