Advanced Features¶
CPU Extensions¶
Implement any CPU layer, that is not support by OpenVINO yet, as a shared library.
Model Cache¶
Leverage the OpenVINO model caching feature to speed up subsequent model loading on a target device.
Custom Model Loader¶
Write your own custom model loader based on a predefined interface and load it similar to a dynamic library.
Securing Model Server with NGINX¶
Protect network endpoints with traffic encryption and client authorization using a reverse proxy