Advanced Features

CPU Extensions

Implement any CPU layer, that is not support by OpenVINO yet, as a shared library.

Learn more

Model Cache

Leverage the OpenVINO model caching feature to speed up subsequent model loading on a target device.

Learn more

Custom Model Loader

Write your own custom model loader based on a predefined interface and load it similar to a dynamic library.

Learn more

Securing Model Server with NGINX

Protect network endpoints with traffic encryption and client authorization using a reverse proxy

Learn more