Writing a Client Application

OpenVINO Model Server exposes two sets of APIs: one compatible with TensorFlow Serving and another one, with KServe API, for inference. Both APIs work on gRPC and REST interfaces. Supporting two sets of APIs makes OpenVINO Model Server easier to plug into existing systems the already leverage one of these APIs for inference. Learn more about supported APIs:

• TensorFlow Serving gRPC API

• KServe gRPC API

• TensorFlow Serving REST API

• KServe REST API

In this section you can find short code samples to interact with OpenVINO Model Server endpoints via:

• TensorFlow Serving API

• KServe API