Install OpenVINO™ GenAI#
OpenVINO GenAI is a tool, simplifying generative AI model inference. It is based on the OpenVINO Runtime, hiding the complexity of the generation process and minimizing the amount of code required. You provide a model and the input context directly to the tool, while it performs tokenization of the input text, executes the generation loop on the selected device, and returns the generated content. For a quickstart guide, refer to the GenAI API Guide.
To see OpenVINO GenAI in action, check these Jupyter notebooks: LLM-powered Chatbot and LLM Instruction-following pipeline.
OpenVINO GenAI is available for installation via PyPI and Archive distributions. A detailed guide on how to build OpenVINO GenAI is available in the OpenVINO GenAI repository.
PyPI Installation#
To install the GenAI package via PyPI, follow the standard installation steps, but use the openvino-genai package instead of openvino:
python -m pip install openvino-genai
Archive Installation#
The OpenVINO GenAI archive package includes the OpenVINO™ Runtime, as well as Tokenizers. It installs the same way as the standard OpenVINO Runtime, so follow its installation steps, just use the OpenVINO GenAI package instead:
Linux#
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/linux/openvino_genai_ubuntu24_2025.0.0.0_x86_64.tar.gz --output openvino_genai_2025.0.0.0.tgz
tar -xf openvino_genai_2025.0.0.0.tgz
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/linux/openvino_genai_ubuntu22_2025.0.0.0_x86_64.tar.gz --output openvino_genai_2025.0.0.0.tgz
tar -xf openvino_genai_2025.0.0.0.tgz
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/linux/openvino_genai_ubuntu20_2025.0.0.0_x86_64.tar.gz --output openvino_genai_2025.0.0.0.tgz
tar -xf openvino_genai_2025.0.0.0.tgz
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/linux/openvino_genai_ubuntu20_2025.0.0.0_arm64.tar.gz -O openvino_genai_2025.0.0.0.tgz
tar -xf openvino_genai_2025.0.0.0.tgz
Windows#
cd <user_home>/Downloads
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/windows/openvino_genai_windows_2025.0.0.0_x86_64.zip --output openvino_genai_2025.0.0.0.zip
macOS#
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/macos/openvino_genai_macos_12_6_2025.0.0.0_x86_64.tar.gz --output openvino_genai_2025.0.0.0.tgz
tar -xf openvino_genai_2025.0.0.0.tgz
curl -L https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/2025.0/macos/openvino_genai_macos_12_6_2025.0.0.0_arm64.tar.gz --output openvino_genai_2025.0.0.0.tgz
tar -xf openvino_genai_2025.0.0.0.tgz