The Inference Engine HDDL plugin is developed for inference of neural networks on Intel® Vision Accelerator Design with Intel® Movidius™ VPUs which is designed for use cases those require large throughput of deep learning inference. It provides dozens amount of throughput as MYRIAD Plugin.
For installation instructions, refer to the Installation Guide for Linux*.
For installation instructions, refer to the Installation Guide for Windows*.
For the "Supported Netwroks", please reference to MYRIAD Plugin
See VPU common configuration parameters for the VPU Plugins.
In addition to common parameters for Myriad plugin and HDDL plugin, HDDL plugin accepts the following options:
Parameter Name | Parameter Values | Default | Description |
---|---|---|---|
KEY_PERF_COUNT | YES/NO | NO | Enable performance counter option |
KEY_VPU_HDDL_GRAPH_TAG | string | empty string | Allows to execute network on specified count of devices |
KEY_VPU_HDDL_STREAM_ID | string | empty string | Allows to execute networks with the same STREAM_ID on the same device |