OpenVINO™ Tools Overview#
This page provides an overview of the most noteworthy tools and components for AI developers, hosted in repositories under the OpenVINO project:
OpenVINO™ GenAI Library simplifies running inference of generative AI models. Check the LLM-powered Chatbot Jupyter notebook to see how GenAI works.
A suite of advanced algorithms for Neural Network inference optimization with minimal accuracy drop. NNCF applies quantization and sparsity algorithms to PyTorch models during training.
A high-performance system that can be used to access the host models via request to the model server.
A collection of Jupyter notebooks for learning and experimenting with the OpenVINO™ Toolkit.
A cross-platform graphic user interface application for running and testing generative and vision AI models on computers or edge devices.
OpenVINO Tokenizers add text processing operations to OpenVINO.