Install OpenVINO™ Runtime for Raspbian OS

Note

  • These steps apply to Raspbian OS (the official OS for Raspberry Pi boards).

  • These steps have been validated with Raspberry Pi 3.

  • There is also an open-source version of OpenVINO™ that can be compiled for arch64 (see build instructions).

Development and Target Systems

Full requirement listing is available in:
  • CMake 3.10 or higher

  • Python 3.7 - 3.10

Step 1: Download and Install OpenVINO Runtime

  1. Open the Terminal or your preferred console application.

  2. Create an installation folder for OpenVINO. If the folder already exists, skip this step.

    sudo mkdir -p /opt/intel
    

    Note

    The /opt/intel path is the recommended folder path for administrators or root users. If you prefer to install OpenVINO in regular userspace, the recommended path is /home/<USER>/intel. You may use a different path if desired.

  3. Go to your ~/Downloads directory and download OpenVINO Runtime archive file for Debian from the OpenVINO package repository.

    cd ~/Downloads/
    sudo wget https://storage.openvinotoolkit.org/repositories/openvino/packages/2022.3.1/linux/l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_armhf.tgz -O openvino_2022.3.1.tgz
    
    cd ~/Downloads/
    sudo wget https://storage.openvinotoolkit.org/repositories/openvino/packages/2022.3.1/linux/l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_arm64.tgz -O openvino_2022.3.1.tgz
    
  4. Extract the archive file and move it to the installation folder:

    sudo tar -xf openvino_2022.3.1.tgz
    sudo mv l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_armhf /opt/intel/openvino_2022.3.1
    
    sudo tar -xf openvino_2022.3.0.tgz
    sudo mv l_openvino_toolkit_debian9_2022.3.1.9227.cf2c7da5689_arm64 /opt/intel/openvino_2022.3.1
    
  5. Install required system dependencies on Linux. To do this, OpenVINO provides a script in the extracted installation directory. Run the following command:

    sudo -E ./install_dependencies/install_openvino_dependencies.sh
    
  6. (Optional) Install numpy Python Library:

    Note

    This step is required only when you decide to use Python API.

    You can use the requirements.txt file from the /opt/intel/openvino_2022.3.1/python/python.<x> folder:

    cd /opt/intel/openvino_2022.3.1
    pip3 install -r ./python/python3.<x>/requirements.txt
    
  7. For simplicity, it is useful to create a symbolic link as below:

    sudo ln -s openvino_2022.3.1 openvino_2022
    

    Note

    If you have already installed a previous release of OpenVINO 2022, a symbolic link to the openvino_2022 folder may already exist. Unlink the previous link with sudo unlink openvino_2022, and then re-run the command above.

Congratulations, you finished the installation! The /opt/intel/openvino_2022 folder now contains the core components for OpenVINO. If you used a different path in Step 2, for example, /home/<USER>/intel/, OpenVINO is then installed in /home/<USER>/intel/openvino_2022. The path to the openvino_2022 directory is also referred as <INSTALL_DIR> throughout the OpenVINO documentation.

Step 2: Install External Software Dependencies

CMake version 3.10 or higher is required for building the OpenVINO™ toolkit sample application. To install, open a Terminal window and run the following command:

sudo apt install cmake

CMake is installed. Continue to the next section to set the environment variables.

Step 3: Set the Environment Variables

You must update several environment variables before you can compile and run OpenVINO applications. Open a terminal window and run the setupvars.sh script as shown below to temporarily set your environment variables. If your <INSTALL_DIR> is not /opt/intel/openvino_2022, use the correct one instead.

source /opt/intel/openvino_2022/setupvars.sh

If you have more than one OpenVINO version on your machine, you can easily switch its version by sourcing the setupvars.sh of your choice.

Note

The above command must be re-run every time you start a new terminal session. To set up Linux to automatically run the command every time a new terminal is opened, open ~/.bashrc in your favorite editor and add source /opt/intel/openvino_2022/setupvars.sh after the last line. Next time when you open a terminal, you will see [setupvars.sh] OpenVINO™ environment initialized. Changing .bashrc is not recommended when you have multiple OpenVINO versions on your machine and want to switch among them.

The environment variables are set. Continue to the next section if you want to download any additional components.

Step 4 (Optional): Install Additional Components

If you want to use your model for inference, the model must be converted to the .bin and .xml Intermediate Representation (IR) files that are used as input by OpenVINO Runtime. To get the optimized models, you can use one of the following options:

  • Download public and Intel’s pre-trained models from the Open Model Zoo using Model Downloader tool. For more information on pre-trained models, see Pre-Trained Models Documentation.

    • OpenCV is necessary to run demos from Open Model Zoo (OMZ). Some OpenVINO samples can also extend their capabilities when compiled with OpenCV as a dependency. To install OpenCV for OpenVINO, see the instructions on Github.

  • Convert the models using the Model Optimizer. Model Optimizer is provided with OpenVINO Development Tools.

    • OpenVINO Development Tools is a set of utilities for working with OpenVINO and OpenVINO models. It provides tools like Model Optimizer, Benchmark Tool, Post-Training Optimization Tool, and Open Model Zoo Downloader. See the Install OpenVINO Development Tools page for step-by-step installation instructions.

Step 5 (Optional): Add USB Rules for an Intel® Neural Compute Stick 2 device

To perform inference on Intel® Neural Compute Stick 2, follow the steps in NCS2 Setup Guide.

What’s Next?

Now that you’ve installed OpenVINO Runtime, you’re ready to run your own machine learning applications! Learn more about how to integrate a model in OpenVINO applications by trying out the following tutorials.

Try the Python Quick Start Example to estimate depth in a scene using an OpenVINO monodepth model in a Jupyter Notebook inside your web browser.

https://user-images.githubusercontent.com/15709723/127752390-f6aa371f-31b5-4846-84b9-18dd4f662406.gif

Visit the Tutorials page for more Jupyter Notebooks to get you started with OpenVINO, such as:

Try the C++ Quick Start Example for step-by-step instructions on building and running a basic image classification C++ application.

https://user-images.githubusercontent.com/36741649/127170593-86976dc3-e5e4-40be-b0a6-206379cd7df5.jpg

Visit the Samples page for other C++ example applications to get you started with OpenVINO, such as:

To uninstall the toolkit, follow the steps on the Uninstalling page.

Additional Resources