kserve / rest-proxyLinks
KServe V2 Protocol Rest API Implementation Proxy
☆11Updated 4 months ago
Alternatives and similar repositories for rest-proxy
Users that are interested in rest-proxy are comparing it to the libraries listed below
Sorting:
- An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.☆131Updated this week
- Holistic job manager on Kubernetes☆116Updated last year
- K8s device plugin for GPU sharing☆99Updated 2 years ago
- WG Serving☆30Updated this week
- resource manifest distribution among multiple clusters.☆29Updated last year
- ☆38Updated last week
- Model Registry provides a single pane of glass for ML model developers to index and manage models, versions, and ML artifacts metadata. I…☆150Updated last week
- KJob: Tool for CLI-loving ML researchers☆39Updated this week
- Prototypes and experiments for WG Device Management.☆12Updated last month
- GenAI inference performance benchmarking tool☆105Updated this week
- A Knative ingress controller for Istio.☆95Updated last week
- ☆174Updated last week
- Integration between knative and certmanager for managing TLS certs automatically.☆22Updated last year
- hub / spoke registration controllers☆42Updated last year
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆110Updated 2 weeks ago
- Seldon Core Operator for Kubernetes☆13Updated 5 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆70Updated 2 months ago
- CNI DRA Driver☆30Updated 2 weeks ago
- DNS service discovery across connected Kubernetes clusters.☆143Updated this week
- Behaviour driven reconciler testing framework.☆30Updated this week
- Argoflow has been superseded by deployKF☆136Updated 2 years ago
- A template project for writing your own controller using the Knative helper libraries.☆75Updated this week
- Distributed Model Serving Framework☆177Updated 2 weeks ago
- ☆23Updated 2 years ago
- ☆17Updated 3 months ago
- ☆29Updated last week
- Example DRA driver that developers can fork and modify to get them started writing their own.☆94Updated last month
- Repository for benchmarking☆79Updated last year
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆99Updated last week
- Repository for open inference protocol specification☆59Updated 5 months ago