Deploying Model Server in Kubernetes

There are three recommended methods for deploying OpenVINO Model Server in Kubernetes:

1. helm chart - deploys Model Server instances using the helm package manager for Kubernetes

2. Kubernetes Operator - manages Model Server using a Kubernetes Operator

3. OpenShift Operator - manages Model Server instances in Red Hat OpenShift

For operators mentioned in 2. and 3. see the description of the deployment process

Next Steps

• Start the server

• Try the model server features

• Explore the model server demos

Additional Resources

• Preparing Model Repository

• Using Cloud Storage

• Troubleshooting

• Model server parameters