kubernetes-sigs / gateway-api-inference-extension
Gateway API Inference Extension
☆243Updated this week
Alternatives and similar repositories for gateway-api-inference-extension:
Users that are interested in gateway-api-inference-extension are comparing it to the libraries listed below
- JobSet: a k8s native API for distributed ML training and HPC workloads☆219Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆402Updated last week
- Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI se…☆220Updated this week
- GenAI inference performance benchmarking tool☆39Updated 3 weeks ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆69Updated last month
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆348Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆127Updated this week
- A federation scheduler for multi-cluster☆37Updated 2 months ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆504Updated this week
- This repository hosts the Multi-Cluster Service APIs. Providers can import packages in this repo to ensure their multi-cluster service co…☆233Updated 2 months ago
- Cluster API Provider for Nested Clusters☆303Updated 7 months ago
- Node Resource Interface☆294Updated last week
- ☆143Updated last week
- ☆114Updated 2 years ago
- ☆117Updated this week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆65Updated last week
- [EOL] Reworking kube-proxy's architecture☆245Updated 9 months ago
- Holistic job manager on Kubernetes☆115Updated last year
- Cloud Native Artifacial Intelligence Model Format Specification☆41Updated last week
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆33Updated this week
- ☆391Updated last week
- Controller for ModelMesh☆228Updated last month
- Applications for Sandbox go here! ⏳📦🧪☆145Updated this week
- WG Serving☆24Updated last week
- A Kubernetes Provider☆277Updated last year
- GPU plugin to the node feature discovery for Kubernetes☆300Updated 10 months ago
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge☆33Updated last year
- ☆107Updated last month
- ☆248Updated 2 weeks ago
- Experiment for Multi cluster controllers with controller-runtime☆139Updated this week