Install OpenVINO™ Runtime for Raspbian OS

Note

• These steps apply to Raspbian OS (the official OS for Raspberry Pi boards).

• These steps have been validated with Raspberry Pi 3.

• There is also an open-source version of OpenVINO™ that can be compiled for arch64 (see build instructions).

Development and Target Systems

System Requirements

Full requirement listing is available in:

System Requirements Page

Software Requirements

• CMake 3.10 or higher

• Python 3.7 - 3.10

Step 1: Download and Install OpenVINO Runtime

1. Open the Terminal or your preferred console application.

2. Create an installation folder for OpenVINO. If the folder already exists, skip this step.

   sudo mkdir -p /opt/intel
   

   Note

   The /opt/intel path is the recommended folder path for administrators or root users. If you prefer to install OpenVINO in regular userspace, the recommended path is /home/<USER>/intel. You may use a different path if desired.

3. Go to your ~/Downloads directory and download OpenVINO Runtime archive file for Debian from the OpenVINO package repository.

   ARM 32-bit

   cd ~/Downloads/
   sudo wget https://storage.openvinotoolkit.org/repositories/openvino/packages/2022.3.2/linux/l_openvino_toolkit_debian9_2022.3.2.9279.e2c7e4d7b4d_armhf.tgz -O openvino_2022.3.2.tgz
   

   ARM 64-bit

   cd ~/Downloads/
   sudo wget https://storage.openvinotoolkit.org/repositories/openvino/packages/2022.3.2/linux/l_openvino_toolkit_debian9_2022.3.2.9279.e2c7e4d7b4d_arm64.tgz -O openvino_2022.3.2.tgz
   

4. Extract the archive file and move it to the installation folder:

   ARM 32-bit

   sudo tar -xf openvino_2022.3.2.tgz
   sudo mv l_openvino_toolkit_debian9_2022.3.2.9279.e2c7e4d7b4d_armhf /opt/intel/openvino_2022.3.2
   

   ARM 64-bit

   sudo tar -xf openvino_2022.3.0.tgz
   sudo mv l_openvino_toolkit_debian9_2022.3.2.9279.e2c7e4d7b4d_arm64 /opt/intel/openvino_2022.3.2
   

5. Install required system dependencies on Linux. To do this, OpenVINO provides a script in the extracted installation directory. Run the following command:

   sudo -E ./install_dependencies/install_openvino_dependencies.sh
   

6. (Optional) Install numpy Python Library:

   Note

   This step is required only when you decide to use Python API.

   You can use the requirements.txt file from the /opt/intel/openvino_2022.3.2/python/python.<x> folder:

   cd /opt/intel/openvino_2022.3.2
   pip3 install -r ./python/python3.<x>/requirements.txt
   

7. For simplicity, it is useful to create a symbolic link as below:

   sudo ln -s openvino_2022.3.2 openvino_2022
   

   Note

   If you have already installed a previous release of OpenVINO 2022, a symbolic link to the openvino_2022 folder may already exist. Unlink the previous link with sudo unlink openvino_2022, and then re-run the command above.

Congratulations, you finished the installation! The /opt/intel/openvino_2022 folder now contains the core components for OpenVINO. If you used a different path in Step 2, for example, /home/<USER>/intel/, OpenVINO is then installed in /home/<USER>/intel/openvino_2022. The path to the openvino_2022 directory is also referred as <INSTALL_DIR> throughout the OpenVINO documentation.

Step 2: Install External Software Dependencies

CMake version 3.10 or higher is required for building the OpenVINO™ toolkit sample application. To install, open a Terminal window and run the following command:

sudo apt install cmake

CMake is installed. Continue to the next section to set the environment variables.

Step 3: Set the Environment Variables

You must update several environment variables before you can compile and run OpenVINO applications. Open a terminal window and run the setupvars.sh script as shown below to temporarily set your environment variables. If your <INSTALL_DIR> is not /opt/intel/openvino_2022, use the correct one instead.

source /opt/intel/openvino_2022/setupvars.sh

If you have more than one OpenVINO version on your machine, you can easily switch its version by sourcing the setupvars.sh of your choice.

Note

The above command must be re-run every time you start a new terminal session. To set up Linux to automatically run the command every time a new terminal is opened, open ~/.bashrc in your favorite editor and add source /opt/intel/openvino_2022/setupvars.sh after the last line. Next time when you open a terminal, you will see [setupvars.sh] OpenVINO™ environment initialized. Changing .bashrc is not recommended when you have multiple OpenVINO versions on your machine and want to switch among them.

The environment variables are set. Continue to the next section if you want to download any additional components.

Step 4 (Optional): Install Additional Components

If you want to use your model for inference, the model must be converted to the .bin and .xml Intermediate Representation (IR) files that are used as input by OpenVINO Runtime. To get the optimized models, you can use one of the following options:

• Download public and Intel’s pre-trained models from the Open Model Zoo using Model Downloader tool. For more information on pre-trained models, see Pre-Trained Models Documentation.

  • OpenCV is necessary to run demos from Open Model Zoo (OMZ). Some OpenVINO samples can also extend their capabilities when compiled with OpenCV as a dependency. To install OpenCV for OpenVINO, see the instructions on Github.

• Convert the models using the Model Optimizer. Model Optimizer is provided with OpenVINO Development Tools.

  • OpenVINO Development Tools is a set of utilities for working with OpenVINO and OpenVINO models. It provides tools like Model Optimizer, Benchmark Tool, Post-Training Optimization Tool, and Open Model Zoo Downloader. See the Install OpenVINO Development Tools page for step-by-step installation instructions.

Step 5 (Optional): Add USB Rules for an Intel® Neural Compute Stick 2 device

To perform inference on Intel® Neural Compute Stick 2, follow the steps in NCS2 Setup Guide.

What’s Next?

Now that you’ve installed OpenVINO Runtime, you’re ready to run your own machine learning applications! Learn more about how to integrate a model in OpenVINO applications by trying out the following tutorials.

Get started with Python

Try the Python Quick Start Example to estimate depth in a scene using an OpenVINO monodepth model in a Jupyter Notebook inside your web browser.

Visit the Tutorials page for more Jupyter Notebooks to get you started with OpenVINO, such as:

• OpenVINO Python API Tutorial

• Basic image classification program with Hello Image Classification

• Convert a PyTorch model and use it for image background removal

Get started with C++

Try the C++ Quick Start Example for step-by-step instructions on building and running a basic image classification C++ application.

Visit the Samples page for other C++ example applications to get you started with OpenVINO, such as:

• Basic object detection with the Hello Reshape SSD C++ sample

• Automatic speech recognition C++ sample

To uninstall the toolkit, follow the steps on the Uninstalling page.

Additional Resources

• Troubleshooting Guide for OpenVINO Installation & Configuration

• Converting models for use with OpenVINO™: Model Optimizer User Guide

• Writing your own OpenVINO™ applications: OpenVINO™ Runtime User Guide

• Sample applications: OpenVINO™ Toolkit Samples Overview

• Pre-trained deep learning models: Overview of OpenVINO™ Toolkit Pre-Trained Models

• IoT libraries and code samples in the GitHUB repository: Intel® IoT Developer Kit

• OpenVINO Installation Selector Tool