kserve / rest-proxy
KServe V2 Protocol Rest API Implementation Proxy
☆10Updated last month
Alternatives and similar repositories for rest-proxy:
Users that are interested in rest-proxy are comparing it to the libraries listed below
- GenAI inference performance benchmarking tool☆17Updated this week
- KJob: Tool for CLI-loving ML researchers☆20Updated this week
- User documentation for KServe.☆104Updated this week
- Example DRA driver that developers can fork and modify to get them started writing their own.☆57Updated this week
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆28Updated this week
- Holistic job manager on Kubernetes☆111Updated last year
- Kubeflow Pipelines on Tekton☆178Updated 3 months ago
- ☆59Updated last week
- Repository for benchmarking☆77Updated 8 months ago
- WG Serving☆19Updated 2 weeks ago
- Controller for ModelMesh☆219Updated last month
- ☆34Updated last week
- Unified runtime-adapter image of the sidecar containers which run in the modelmesh pods☆21Updated last month
- ☆11Updated 4 months ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆20Updated 2 months ago
- 🏃🏿♀️🏃🏽♀️🏃🏻♂️🕒CNCF Technical Advisory Group for Runtime☆90Updated 2 months ago
- Argoflow has been superseded by deployKF☆136Updated last year
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆62Updated 3 weeks ago
- Seldon Core Operator for Kubernetes☆12Updated 5 years ago
- ☆113Updated 2 years ago
- A benchmarking tool to evaluate Knative performance☆37Updated last year
- IPAM plugin for kubernetes☆16Updated this week
- Kubernetes Operator, ansible playbooks, and production scripts for large-scale AIStore deployments on Kubernetes.☆89Updated this week
- kfctl is a CLI for deploying and managing Kubeflow☆184Updated last year
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆15Updated 3 months ago
- A template project for writing your own controller using the Knative helper libraries.☆72Updated this week
- hub / spoke registration controllers☆42Updated 4 months ago
- Container Object Storage Interface (COSI) provisioner responsible to interface with COSI drivers. NOTE: The content of this repo has bee…☆35Updated 2 months ago
- Incubating: A framework for writing Kubernetes Device Plugins☆32Updated 3 weeks ago