Install Intel® Distribution of OpenVINO™ toolkit for Linux*

NOTES:

• These steps apply to Ubuntu*, CentOS*, and Yocto*.
• If you are using Intel® Distribution of OpenVINO™ toolkit on Windows* OS, see the Installation Guide for Windows*.
• CentOS and Yocto installations will require some modifications that are not covered in this guide.
• An internet connection is required to follow the steps in this guide.
• Intel® System Studio is an all-in-one, cross-platform tool suite, purpose-built to simplify system bring-up and improve system and IoT device application performance on Intel® platforms. If you are using the Intel® Distribution of OpenVINO™ with Intel® System Studio, go to Get Started with Intel® System Studio.

Introduction

OpenVINO™ toolkit is a comprehensive toolkit for quickly developing applications and solutions that solve a variety of tasks including emulation of human vision, automatic speech recognition, natural language processing, recommendation systems, and many others. Based on latest generations of artificial neural networks, including Convolutional Neural Networks (CNNs), recurrent and attention-based networks, the toolkit extends computer vision and non-vision workloads across Intel® hardware, maximizing performance. It accelerates applications with high-performance, AI and deep learning inference deployed from edge to cloud.

The Intel® Distribution of OpenVINO™ toolkit for Linux*:

• Enables CNN-based deep learning inference on the edge
• Supports heterogeneous execution across Intel® CPU, Intel® Integrated Graphics, Intel® Neural Compute Stick 2, and Intel® Vision Accelerator Design with Intel® Movidius™ VPUs
• Speeds time-to-market via an easy-to-use library of computer vision functions and pre-optimized kernels
• Includes optimized calls for computer vision standards including OpenCV* and OpenCL™

Included with the Installation and installed by default:

Component	Description
Model Optimizer	This tool imports, converts, and optimizes models that were trained in popular frameworks to a format usable by Intel tools, especially the Inference Engine.  Popular frameworks include Caffe*, TensorFlow*, MXNet*, and ONNX*.
Inference Engine	This is the engine that runs the deep learning model. It includes a set of libraries for an easy inference integration into your applications.
Intel® Media SDK	Offers access to hardware accelerated video codecs and frame processing
OpenCV	OpenCV* community version compiled for Intel® hardware
Inference Engine Code Samples	A set of simple console applications demonstrating how to utilize specific OpenVINO capabilities in an application and how to perform specific tasks, such as loading a model, running inference, querying specific device capabilities, and more.
Demo Applications	A set of simple console applications that provide robust application templates to help you implement specific deep learning scenarios.
Additional Tools	A set of tools to work with your models including Accuracy Checker utility, Post-Training Optimization Tool Guide, Model Downloader and other
Documentation for Pre-Trained Models	Documentation for the pre-trained models available in the Open Model Zoo repo.
Deep Learning Streamer (DL Streamer)	Streaming analytics framework, based on GStreamer, for constructing graphs of media analytics components. For the DL Streamer documentation, see DL Streamer Samples, API Reference, Elements, Tutorial.

Could Be Optionally Installed

Deep Learning Workbench (DL Workbench) is a platform built upon OpenVINO™ and provides a web-based graphical environment that enables you to optimize, fine-tune, analyze, visualize, and compare performance of deep learning models on various Intel® architecture configurations. In the DL Workbench, you can use most of OpenVINO™ toolkit components:

• Model Downloader
• Intel® Open Model Zoo
• Model Optimizer
• Post-training Optimization Tool
• Accuracy Checker
• Benchmark Tool

Proceed to an easy installation from Docker to get started.

System Requirements

Hardware

• 6th to 11th generation Intel® Core™ processors and Intel® Xeon® processors
• 3rd generation Intel® Xeon® Scalable processor (formerly code named Cooper Lake)
• Intel® Xeon® Scalable processor (formerly Skylake and Cascade Lake)
• Intel Atom® processor with support for Intel® Streaming SIMD Extensions 4.1 (Intel® SSE4.1)
• Intel Pentium® processor N4200/5, N3350/5, or N3450/5 with Intel® HD Graphics
• Intel® Neural Compute Stick 2
• Intel® Vision Accelerator Design with Intel® Movidius™ VPUs

NOTE: With OpenVINO™ 2020.4 release, Intel® Movidius™ Neural Compute Stick is no longer supported.

Processor Notes:

• Processor graphics are not included in all processors. See Product Specifications for information about your processor.
• A chipset that supports processor graphics is required for Intel® Xeon® processors.

Operating Systems

• Ubuntu 18.04.x long-term support (LTS), 64-bit
• Ubuntu 20.04.0 long-term support (LTS), 64-bit
• CentOS 7.6, 64-bit (for target only)
• Yocto Project v3.0, 64-bit (for target only and requires modifications)

Overview

This guide provides step-by-step instructions on how to install the Intel® Distribution of OpenVINO™ toolkit. Links are provided for each type of compatible hardware including downloads, initialization and configuration steps. The following steps will be covered:

1. Install the Intel® Distribution of OpenVINO™ Toolkit
2. Install External software dependencies
3. Set the OpenVINO™ Environment Variables: Optional Update to .bashrc.
4. Configure the Model Optimizer
5. Steps for Intel® Processor Graphics (GPU)
6. Steps for Intel® Neural Compute Stick 2
7. Steps for Intel® Vision Accelerator Design with Intel® Movidius™ VPU
   After installing your Intel® Movidius™ VPU, you will return to this guide to complete OpenVINO™ installation.
8. Get Started with Code Samples and Demo Applications
9. Steps to uninstall the Intel® Distribution of OpenVINO™ Toolkit.

Install the Intel® Distribution of OpenVINO™ Toolkit Core Components

Download the Intel® Distribution of OpenVINO™ toolkit package file from Intel® Distribution of OpenVINO™ toolkit for Linux*. Select the Intel® Distribution of OpenVINO™ toolkit for Linux package from the dropdown menu.

1. Open a command prompt terminal window.
2. Change directories to where you downloaded the Intel Distribution of OpenVINO toolkit for Linux* package file.
   If you downloaded the package file to the current user's Downloads directory:

   cd ~/Downloads/

   By default, the file is saved as l_openvino_toolkit_p_<version>.tgz.
3. Unpack the .tgz file:

   tar -xvzf l_openvino_toolkit_p_<version>.tgz

   The files are unpacked to the l_openvino_toolkit_p_<version> directory.
4. Go to the l_openvino_toolkit_p_<version> directory:

   cd l_openvino_toolkit_p_<version>

   If you have a previous version of the Intel Distribution of OpenVINO toolkit installed, rename or delete these two directories:
   • ~/inference_engine_samples_build
   • ~/openvino_models
5. Choose your installation option and run the related script as root to use either a GUI installation wizard or command line instructions (CLI).
   
   Screenshots are provided for the GUI, but not for CLI. The following information also applies to CLI and will be helpful to your installation where you will be presented with the same choices and tasks.
   • Option 1: GUI Installation Wizard:

     sudo ./install_GUI.sh

   • Option 2: Command Line Instructions:

     sudo ./install.sh

   • Option 3: Command Line Silent Instructions:

     sudo sed -i 's/decline/accept/g' silent.cfg
     sudo ./install.sh -s silent.cfg

     You can select which OpenVINO components will be installed by modifying the COMPONENTS parameter in the silent.cfg file. For example, to install only CPU runtime for the Inference Engine, set COMPONENTS=intel-openvino-ie-rt-cpu__x86_64 in silent.cfg. To get a full list of available components for installation, run the ./install.sh --list_components command from the unpacked OpenVINO™ toolkit package.
6. Follow the instructions on your screen. Watch for informational messages such as the following in case you must complete additional steps:

1. If you select the default options, the Installation summary GUI screen looks like this:

   By default, the Intel® Distribution of OpenVINO™ is installed to the following directory, referred to as <INSTALL_DIR>:

   • For root or administrator: /opt/intel/openvino_<version>/
   • For regular users: /home/<USER>/intel/openvino_<version>/ For simplicity, a symbolic link to the latest installation is also created: /opt/intel/openvino_2021/.
2. Optional: You can choose Customize to change the installation directory or the components you want to install:

   NOTE: If there is an OpenVINO™ toolkit version previously installed on your system, the installer will use the same destination directory for next installations. If you want to install a newer version to a different directory, you need to uninstall the previously installed versions.

   

NOTE: The Intel® Media SDK component is always installed in the /opt/intel/mediasdk directory regardless of the OpenVINO installation path chosen.

9. A Complete screen indicates that the core components have been installed:

The first core components are installed. Continue to the next section to install additional dependencies.

Install External Software Dependencies

NOTE: If you installed the Intel® Distribution of OpenVINO™ to the non-default install directory, replace /opt/intel with the directory in which you installed the software.

These dependencies are required for:

• Intel-optimized build of OpenCV library
• Deep Learning Inference Engine
• Deep Learning Model Optimizer tools

1. Change to the install_dependencies directory:

   cd /opt/intel/openvino_2021/install_dependencies

2. Run a script to download and install the external software dependencies:

   sudo -E ./install_openvino_dependencies.sh

   The dependencies are installed. Continue to the next section to set your environment variables.

Set the Environment Variables

You must update several environment variables before you can compile and run OpenVINO™ applications. Run the following script to temporarily set your environment variables:

source /opt/intel/openvino_2021/bin/setupvars.sh

Optional: The OpenVINO environment variables are removed when you close the shell. As an option, you can permanently set the environment variables as follows:

1. Open the .bashrc file in <user_directory>:

   vi <user_directory>/.bashrc

2. Add this line to the end of the file:

   source /opt/intel/openvino_2021/bin/setupvars.sh

3. Save and close the file: press the Esc key and type :wq.
4. To test your change, open a new terminal. You will see [setupvars.sh] OpenVINO environment initialized.

The environment variables are set. Continue to the next section to configure the Model Optimizer.

Configure the Model Optimizer

The Model Optimizer is a Python*-based command line tool for importing trained models from popular deep learning frameworks such as Caffe*, TensorFlow*, Apache MXNet*, ONNX* and Kaldi*.

The Model Optimizer is a key component of the Intel Distribution of OpenVINO toolkit. You cannot perform inference on your trained model without running the model through the Model Optimizer. When you run a pre-trained model through the Model Optimizer, your output is an Intermediate Representation (IR) of the network. The Intermediate Representation is a pair of files that describe the whole model:

• .xml: Describes the network topology
• .bin: Contains the weights and biases binary data

For more information about the Model Optimizer, refer to the Model Optimizer Developer Guide. 

Model Optimizer Configuration Steps

You can choose to either configure all supported frameworks at once OR configure one framework at a time. Choose the option that best suits your needs. If you see error messages, make sure you installed all dependencies.

NOTE: Since the TensorFlow framework is not officially supported on CentOS*, the Model Optimizer for TensorFlow can't be configured and ran on those systems.

IMPORTANT: The Internet access is required to execute the following steps successfully. If you have access to the Internet through the proxy server only, please make sure that it is configured in your OS environment.

Option 1: Configure all supported frameworks at the same time

1. Go to the Model Optimizer prerequisites directory:

   cd /opt/intel/openvino_2021/deployment_tools/model_optimizer/install_prerequisites

2. Run the script to configure the Model Optimizer for Caffe, TensorFlow 1.x, MXNet, Kaldi*, and ONNX:

   sudo ./install_prerequisites.sh

Option 2: Configure each framework separately

Configure individual frameworks separately ONLY if you did not select Option 1 above.

1. Go to the Model Optimizer prerequisites directory:

   cd /opt/intel/openvino_2021/deployment_tools/model_optimizer/install_prerequisites

2. Run the script for your model framework. You can run more than one script:
   • For Caffe:

     sudo ./install_prerequisites_caffe.sh

   • For TensorFlow 1.x:

     sudo ./install_prerequisites_tf.sh

   • For TensorFlow 2.x:

     sudo ./install_prerequisites_tf2.sh

   • For MXNet:

     sudo ./install_prerequisites_mxnet.sh

   • For ONNX:

     sudo ./install_prerequisites_onnx.sh

   • For Kaldi:

     sudo ./install_prerequisites_kaldi.sh

     The Model Optimizer is configured for one or more frameworks.

You have completed all required installation, configuration and build steps in this guide to use your CPU to work with your trained models.

To enable inference on other hardware, see:

• Steps for Intel® Processor Graphics (GPU)
• Steps for Intel® Neural Compute Stick 2
• Steps for Intel® Vision Accelerator Design with Intel® Movidius™ VPUs
  

Or proceed to the Get Started to get started with running code samples and demo applications.

Steps for Intel® Processor Graphics (GPU)

The steps in this section are required only if you want to enable the toolkit components to use processor graphics (GPU) on your system.

1. Go to the install_dependencies directory:

   cd /opt/intel/openvino_2021/install_dependencies/

2. Enter the super user mode:

   sudo -E su

3. Install the Intel® Graphics Compute Runtime for OpenCL™ driver components required to use the GPU plugin and write custom layers for Intel® Integrated Graphics. The drivers are not included in the package, to install it, make sure you have the internet connection and run the installation script:

   ./install_NEO_OCL_driver.sh

   The script compares the driver version on the system to the current version. If the driver version on the system is higher or equal to the current version, the script does not install a new driver. If the version of the driver is lower than the current version, the script uninstalls the lower and installs the current version with your permission:

   Higher hardware versions require a higher driver version, namely 20.35 instead of 19.41. If the script fails to uninstall the driver, uninstall it manually. During the script execution, you may see the following command line output:
   

   Add OpenCL user to video group    

   Ignore this suggestion and continue.
   You can also find the most recent version of the driver, installation procedure and other information in the https://github.com/intel/compute-runtime/ repository.

4. Optional Install header files to allow compiling a new code. You can find the header files at Khronos OpenCL™ API Headers.

You've completed all required configuration steps to perform inference on processor graphics. Proceed to the Get Started to get started with running code samples and demo applications.

Steps for Intel® Neural Compute Stick 2

These steps are only required if you want to perform inference on Intel® Movidius™ NCS powered by the Intel® Movidius™ Myriad™ 2 VPU or Intel® Neural Compute Stick 2 powered by the Intel® Movidius™ Myriad™ X VPU. See also the Get Started page for Intel® Neural Compute Stick 2:

1. Add the current Linux user to the users group:

   sudo usermod -a -G users "$(whoami)"

   Log out and log in for it to take effect.
2. To perform inference on Intel® Neural Compute Stick 2, install the USB rules as follows:

   sudo cp /opt/intel/openvino_2021/inference_engine/external/97-myriad-usbboot.rules /etc/udev/rules.d/

   sudo udevadm control --reload-rules

   sudo udevadm trigger

   sudo ldconfig

   NOTE: You may need to reboot your machine for this to take effect.

   You've completed all required configuration steps to perform inference on Intel® Neural Compute Stick 2. Proceed to the Get Started to get started with running code samples and demo applications.

Steps for Intel® Vision Accelerator Design with Intel® Movidius™ VPUs

To install and configure your Intel® Vision Accelerator Design with Intel® Movidius™ VPUs, see the Intel® Vision Accelerator Design with Intel® Movidius™ VPUs Configuration Guide.

NOTE: After installing your Intel® Movidius™ VPU, you will return to this guide to complete the Intel® Distribution of OpenVINO™ installation.

After configuration is done, you are ready to run the verification scripts with the HDDL Plugin for your Intel® Vision Accelerator Design with Intel® Movidius™ VPUs:

1. Go to the Inference Engine demo directory:

   cd /opt/intel/openvino_2021/deployment_tools/demo

2. Run the Image Classification verification script. If you have access to the Internet through the proxy server only, please make sure that it is configured in your OS environment.

   ./demo_squeezenet_download_convert_run.sh -d HDDL

3. Run the Inference Pipeline verification script:

   ./demo_security_barrier_camera.sh -d HDDL

You've completed all required configuration steps to perform inference on Intel® Vision Accelerator Design with Intel® Movidius™ VPUs. Proceed to the Get Started to get started with running code samples and demo applications.

Get Started

Now you are ready to get started. To continue, see the following pages:

• OpenVINO™ Toolkit Overview
• Get Started Guide for Linux to learn the basic OpenVINO™ toolkit workflow and run code samples and demo applications with pre-trained models on different inference devices.

Uninstall the Intel® Distribution of OpenVINO™ Toolkit

Choose one of the options provided below to uninstall the Intel® Distribution of OpenVINO™ Toolkit from your system.

Uninstall with GUI

1. Run the uninstallation script from <INSTALL_DIR>/openvino_toolkit_uninstaller:

   sudo ./uninstall_GUI.sh

2. Follow the uninstallation wizard instructions.

Uninstall with Command Line (Interactive Mode)

1. Run the uninstallation script from <INSTALL_DIR>/openvino_toolkit_uninstaller:

   sudo ./uninstall.sh

2. Follow the instructions on your screen.
3. When uninstallation is complete, press Enter.

Uninstall with Command Line (Silent Mode)

1. Run the following command from <INSTALL_DIR>/openvino_toolkit_uninstaller:

   sudo ./uninstall.sh -s

2. Intel® Distribution of OpenVINO™ Toolkit is now uninstalled from your system.

Troubleshooting

PRC developers might encounter pip installation related issues during OpenVINO™ installation. To resolve the issues, you may use one of the following options at your discretion:

• Add the download source with -i parameter in the pip command. For example:

  pip install numpy.py -i https://mirrors.aliyun.com/pypi/simple/

  Use the --trusted-host parameter if the URL above is http instead of https.
• Modify or create ~/.pip/pip.conf file to change the default download source with the content below:

  [global]
  index-url = http://mirrors.aliyun.com/pypi/simple/
  [install]
  trusted-host = mirrors.aliyun.com

Additional Resources

• Intel® Distribution of OpenVINO™ toolkit home page: https://software.intel.com/en-us/openvino-toolkit
• OpenVINO™ toolkit online documentation: https://docs.openvinotoolkit.org
• Model Optimizer Developer Guide.
• Inference Engine Developer Guide.
• For more information on Sample Applications, see the Inference Engine Samples Overview.
• For information on a set of pre-trained models, see the Overview of OpenVINO™ Toolkit Pre-Trained Models
• For IoT Libraries and Code Samples see the Intel® IoT Developer Kit.

To learn more about converting models, go to:

• Convert Your Caffe* Model
• Convert Your TensorFlow* Model
• Convert Your MXNet* Model
• Convert Your ONNX* Model