Support for Binary Input Data

While OpenVINO models don’t have the ability to process images directly in their binary format, the model server can accept them and convert automatically from JPEG/PNG to OpenVINO friendly format using built-in OpenCV library. To take adventage of this feature, there are two requirements:

  1. Model input, that receives binary encoded image, must have a proper shape and layout. Learn more about this requirement in input shape and layout considerations document.

  2. Inference request sent to the server must have ceratain properties. These properties are different depending on the API (KServe or TensorFlow Serving) and interface (gRPC or REST). Choose the API you are using and learn more:

    It’s worth noting that with KServe API, you can also send raw data (that does not require processing by OpenCV) in binary form via REST. This makes KServe API more performant choice while working with REST interface. The guide linked above explains how to work with both regular data in binary format as well as JPEG/PNG encoded images.