OpenVINO™ Ecosystem Overview#
OpenVINO™ is a big project, offering more than just the core runtime. This page will give you an overview of a whole ecosystem of tools and solutions under the OpenVINO umbrella.
OpenVINO™ GenAI Library aims to simplify running inference of generative AI models. Check the LLM-powered Chatbot Jupyter notebook to see how GenAI works.
A suite of advanced algorithms for Neural Network inference optimization with minimal accuracy drop. NNCF applies quantization, filter pruning, binarization, and sparsity algorithms to PyTorch and TensorFlow models during training.
A high-performance system that can be used to access the host models via request to the model server.
A collection of Jupyter notebooks for learning and experimenting with the OpenVINO™ Toolkit.
A Hugging Face repository hosting pre-optimized OpenVINO IR models, so that you can use them without the need to convert.
A convenient environment to train Deep Learning models and convert them using the OpenVINO™ toolkit for optimized inference.
A solution for Model Developers and Independent Software Vendors to use secure packaging and secure model execution.
A framework and a CLI tool for building, transforming, and analyzing datasets.
Intel’s new software for building computer vision models in a fraction of the time and with less data. This software eases laborious data labeling, model training and optimization tasks across the AI model development process, empowering teams to produce custom AI models at scale.
OpenVINO™ Test Drive is cross-platform graphic user interface application that enables running generative AI and vision models directly on your computer or edge device using OpenVINO™ Runtime.
OpenVINO Tokenizers add text processing operations to OpenVINO.
Open Model Zoo includes optimized deep learning models and a set of demos to expedite development of high-performance deep learning inference applications.
OpenVINO-based AI projects#
OpenVINO is used in many educational, multimodal, and AI projects in the fields of AI Audio, Natural Language Processing, AI Computer Vision, Generative AI, operating systems and API extensions. Examples of such projects are: OpenVINO AI Plugins for GIMP, OpenVINO Code, and NVIDIA GPU Plugin.
A detailed listing of OpenVINO-based AI projects is available in the Awesome OpenVINO repository