envoyproxy / ai-gateway
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
☆220Updated this week
Alternatives and similar repositories for ai-gateway:
Users that are interested in ai-gateway are comparing it to the libraries listed below
- Gateway API Inference Extension☆229Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆218Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆402Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆123Updated this week
- ☆126Updated this week
- Example DRA driver that developers can fork and modify to get them started writing their own.☆69Updated last month
- GenAI inference performance benchmarking tool☆36Updated 2 weeks ago
- All the things to make the scheduler extendable with wasm.☆116Updated 3 months ago
- A federation scheduler for multi-cluster☆36Updated 2 months ago
- Contains miscellaneous Wasm extensions for Istio☆118Updated 2 weeks ago
- Generates Kubernetes CRD API reference documentation☆123Updated last week
- Experiment for Multi cluster controllers with controller-runtime☆136Updated 3 weeks ago
- A Go framework for end-to-end testing of components running in Kubernetes clusters.☆568Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆483Updated this week
- [EOL] Reworking kube-proxy's architecture☆246Updated 9 months ago
- This repository hosts the Multi-Cluster Service APIs. Providers can import packages in this repo to ensure their multi-cluster service co…☆233Updated last month
- ☆51Updated last year
- Prow is a Kubernetes based CI/CD system developed to serve the Kubernetes community. This repository contains Prow source code and Hugo s…☆182Updated last week
- A toolkit for discovering cluster network topology.☆45Updated 2 weeks ago
- Kubernetes Work API☆66Updated 3 weeks ago
- Node Resource Interface☆294Updated last week
- Smart Kubernetes Scheduling☆78Updated last week
- xDS API Working Group☆225Updated 3 weeks ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆65Updated this week
- Cloud Native Agentic AI | Discord: https://bit.ly/kagentdiscord☆563Updated this week
- Small xDS control plane example.☆96Updated 3 months ago
- A toolkit for building declarative operators with kubebuilder☆262Updated last month
- Applications for Sandbox go here! ⏳📦🧪☆145Updated 2 weeks ago
- Holistic job manager on Kubernetes☆115Updated last year
- K8s device plugin for GPU sharing☆100Updated last year