namespace InferenceEngine::Metrics¶
Overview¶
Metrics More…
namespace Metrics {
// enums
enum DeviceType;
// global variables
static constexpr auto METRIC_AVAILABLE_DEVICES = "AVAILABLE_DEVICES";
static constexpr auto METRIC_SUPPORTED_METRICS = "SUPPORTED_METRICS";
static constexpr auto METRIC_SUPPORTED_CONFIG_KEYS = "SUPPORTED_CONFIG_KEYS";
static constexpr auto METRIC_FULL_DEVICE_NAME = "FULL_DEVICE_NAME";
static constexpr auto METRIC_OPTIMIZATION_CAPABILITIES = "OPTIMIZATION_CAPABILITIES";
static constexpr auto FP32 = "FP32";
static constexpr auto BF16 = "BF16";
static constexpr auto FP16 = "FP16";
static constexpr auto INT8 = "INT8";
static constexpr auto BIN = "BIN";
static constexpr auto WINOGRAD = "WINOGRAD";
static constexpr auto BATCHED_BLOB = "BATCHED_BLOB";
static constexpr auto METRIC_RANGE_FOR_STREAMS = "RANGE_FOR_STREAMS";
static constexpr auto METRIC_RANGE_FOR_ASYNC_INFER_REQUESTS = "RANGE_FOR_ASYNC_INFER_REQUESTS";
static constexpr auto METRIC_NUMBER_OF_WAITING_INFER_REQUESTS = "NUMBER_OF_WAITING_INFER_REQUESTS";
static constexpr auto METRIC_NUMBER_OF_EXEC_INFER_REQUESTS = "NUMBER_OF_EXEC_INFER_REQUESTS";
static constexpr auto METRIC_DEVICE_ARCHITECTURE = "DEVICE_ARCHITECTURE";
static constexpr auto METRIC_DEVICE_TYPE = "DEVICE_TYPE";
static constexpr auto METRIC_DEVICE_GOPS = "DEVICE_GOPS";
static constexpr auto METRIC_IMPORT_EXPORT_SUPPORT = "IMPORT_EXPORT_SUPPORT";
static constexpr auto METRIC_NETWORK_NAME = "NETWORK_NAME";
static constexpr auto METRIC_DEVICE_THERMAL = "DEVICE_THERMAL";
static constexpr auto METRIC_OPTIMAL_NUMBER_OF_INFER_REQUESTS = "OPTIMAL_NUMBER_OF_INFER_REQUESTS";
} // namespace Metrics
Detailed Documentation¶
Metrics
Global Variables¶
static constexpr auto METRIC_AVAILABLE_DEVICES = "AVAILABLE_DEVICES"
Metric to get a std::vector<std::string> of available device IDs. String value is “AVAILABLE_DEVICES”.
static constexpr auto METRIC_SUPPORTED_METRICS = "SUPPORTED_METRICS"
Metric to get a std::vector<std::string> of supported metrics. String value is “SUPPORTED_METRICS”.
This can be used as an executable network metric as well.
Each of the returned device metrics can be passed to Core::GetMetric, executable network metrics can be passed to ExecutableNetwork::GetMetric.
static constexpr auto METRIC_SUPPORTED_CONFIG_KEYS = "SUPPORTED_CONFIG_KEYS"
Metric to get a std::vector<std::string> of supported config keys. String value is “SUPPORTED_CONFIG_KEYS”.
This can be used as an executable network metric as well.
Each of the returned device configuration keys can be passed to Core::SetConfig, Core::GetConfig, and Core::LoadNetwork, configuration keys for executable networks can be passed to ExecutableNetwork::SetConfig and ExecutableNetwork::GetConfig.
static constexpr auto METRIC_FULL_DEVICE_NAME = "FULL_DEVICE_NAME"
Metric to get a std::string value representing a full device name. String value is “FULL_DEVICE_NAME”.
static constexpr auto METRIC_OPTIMIZATION_CAPABILITIES = "OPTIMIZATION_CAPABILITIES"
Metric to get a std::vector<std::string> of optimization options per device. String value is “OPTIMIZATION_CAPABILITIES”.
The possible values:
“FP32” - device can support FP32 models
“BF16” - device can support BF16 computations for models
“FP16” - device can support FP16 models
“INT8” - device can support models with INT8 layers
“BIN” - device can support models with BIN layers
“WINOGRAD” - device can support models where convolution implemented via Winograd transformations
“BATCHED_BLOB” - device can support BatchedBlob
static constexpr auto METRIC_RANGE_FOR_STREAMS = "RANGE_FOR_STREAMS"
Metric to provide information about a range for streams on platforms where streams are supported.
Metric returns a value of std::tuple<unsigned int, unsigned int> type, where:
First value is bottom bound.
Second value is upper bound. String value for metric name is “RANGE_FOR_STREAMS”.
static constexpr auto METRIC_RANGE_FOR_ASYNC_INFER_REQUESTS = "RANGE_FOR_ASYNC_INFER_REQUESTS"
Metric to provide a hint for a range for number of async infer requests. If device supports streams, the metric provides range for number of IRs per stream.
Metric returns a value of std::tuple<unsigned int, unsigned int, unsigned int> type, where:
First value is bottom bound.
Second value is upper bound.
Third value is step inside this range. String value for metric name is “RANGE_FOR_ASYNC_INFER_REQUESTS”.
static constexpr auto METRIC_NUMBER_OF_WAITING_INFER_REQUESTS = "NUMBER_OF_WAITING_INFER_REQUESTS"
Metric to get an unsigned int value of number of waiting infer request.
String value is “NUMBER_OF_WAITNING_INFER_REQUESTS”. This can be used as an executable network metric as well
static constexpr auto METRIC_NUMBER_OF_EXEC_INFER_REQUESTS = "NUMBER_OF_EXEC_INFER_REQUESTS"
Metric to get an unsigned int value of number of infer request in execution stage.
String value is “NUMBER_OF_EXEC_INFER_REQUESTS”. This can be used as an executable network metric as well
static constexpr auto METRIC_DEVICE_ARCHITECTURE = "DEVICE_ARCHITECTURE"
Metric which defines the device architecture.
static constexpr auto METRIC_DEVICE_TYPE = "DEVICE_TYPE"
Metric to get a type of device. See DeviceType enum definition for possible return values.
static constexpr auto METRIC_DEVICE_GOPS = "DEVICE_GOPS"
Metric which defines Giga OPS per second count (GFLOPS or GIOPS) for a set of precisions supported by specified device.
static constexpr auto METRIC_IMPORT_EXPORT_SUPPORT = "IMPORT_EXPORT_SUPPORT"
Metric which defines support of import/export functionality by plugin.
static constexpr auto METRIC_NETWORK_NAME = "NETWORK_NAME"
Metric to get a name of network. String value is “NETWORK_NAME”.
static constexpr auto METRIC_DEVICE_THERMAL = "DEVICE_THERMAL"
Metric to get a float of device thermal. String value is “DEVICE_THERMAL”.
static constexpr auto METRIC_OPTIMAL_NUMBER_OF_INFER_REQUESTS = "OPTIMAL_NUMBER_OF_INFER_REQUESTS"
Metric to get an unsigned integer value of optimal number of executable network infer requests.