envoyproxy / ai-gateway
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
☆246Updated this week
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Gateway API Inference Extension☆269Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆226Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆428Updated last week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆163Updated this week
- Next Generation Agentic Proxy☆151Updated this week
- ☆150Updated 3 weeks ago
- Contains miscellaneous Wasm extensions for Istio☆118Updated last month
- This repository hosts the Multi-Cluster Service APIs. Providers can import packages in this repo to ensure their multi-cluster service co…☆233Updated 2 months ago
- GenAI inference performance benchmarking tool☆41Updated this week
- Example DRA driver that developers can fork and modify to get them started writing their own.☆69Updated last week
- Declarative Workflow of KubeVela which can run as standalone.☆120Updated last week
- ☆393Updated this week
- Automatic SRE Superpowers within your Kubernetes cluster☆366Updated this week
- All the things to make the scheduler extendable with wasm.☆117Updated 3 months ago
- K8s device plugin for GPU sharing☆100Updated 2 years ago
- Experiment for Multi cluster controllers with controller-runtime☆150Updated this week
- Alternate Kafka Broker implementation.☆195Updated this week
- Prow is a Kubernetes based CI/CD system developed to serve the Kubernetes community. This repository contains Prow source code and Hugo s…☆189Updated last week
- Cluster API Provider for Nested Clusters☆303Updated 7 months ago
- Spin Operator is a Kubernetes operator that empowers platform engineers to deploy Spin applications as custom resources to their Kubernet…☆251Updated last week
- A federation scheduler for multi-cluster☆39Updated 2 months ago
- A toolkit for discovering cluster network topology.☆46Updated last week
- Global control plane tracing for Kubernetes☆269Updated 3 weeks ago
- An AI-Powered assistant for Kubernetes developers☆182Updated last year
- Multi-cluster api gateway based on apiserver-aggregation.☆102Updated 4 months ago
- The `ztunnel` component of ambient mesh☆372Updated this week
- eBPF Collector☆339Updated last month
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆539Updated this week
- Cloud Native Agentic AI | Discord: https://bit.ly/kagentdiscord☆699Updated this week
- [EOL] Reworking kube-proxy's architecture☆245Updated 10 months ago