Performance Benchmarks

The  Intel® Distribution of OpenVINO™ toolkit  helps accelerate deep learning inference across a variety of Intel® processors and accelerators.

The benchmark results below demonstrate high performance gains on several public neural networks on multiple Intel® CPUs, GPUs and GNAs covering a broad performance range. The results may be helpful when deciding which hardware is best for your applications or to plan AI workload on the Intel computing already included in your solutions.

Benchmarks are available for:

You can also test performance for your system yourself, following the guide on getting performance numbers. Performance of a particular application can also be evaluated virtually using Intel® DevCloud for the Edge. It is a remote development environment with access to Intel® hardware and the latest versions of the Intel® Distribution of the OpenVINO™ Toolkit. To learn more about it, visit the website or create an account.