envoyproxy / ai-gatewayLinks
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
☆315Updated this week
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Gateway API Inference Extension☆351Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆236Updated last week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆486Updated last week
- Next Generation Agentic Proxy☆208Updated last week
- ☆157Updated last week
- Spin Operator is a Kubernetes operator that empowers platform engineers to deploy Spin applications as custom resources to their Kubernet…☆255Updated 2 weeks ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆656Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆204Updated this week
- All the things to make the scheduler extendable with wasm.☆122Updated last week
- AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-te…☆997Updated last week
- This repository hosts the Multi-Cluster Service APIs. Providers can import packages in this repo to ensure their multi-cluster service co…☆238Updated this week
- K8s-mcp-server is a Model Context Protocol (MCP) server that enables AI assistants like Claude to securely execute Kubernetes commands. I…☆149Updated last month
- This Kubernetes Operators installs WebAssembly support on your Kubernetes Nodes☆232Updated this week
- The `ztunnel` component of ambient mesh☆383Updated this week
- A federation scheduler for multi-cluster☆44Updated this week
- Smart Kubernetes Scheduling☆79Updated last week
- Convert Ingress resources to Gateway API resources☆482Updated last month
- Dynamic Resource Allocation (DRA) for NVIDIA GPUs in Kubernetes☆377Updated this week
- ☆403Updated last week
- Experiment for Multi cluster controllers with controller-runtime☆167Updated last week
- A toolkit for discovering cluster network topology.☆54Updated last week
- [EOL] Reworking kube-proxy's architecture☆246Updated 11 months ago
- GenAI inference performance benchmarking tool☆58Updated this week
- Contains miscellaneous Wasm extensions for Istio☆118Updated 2 months ago
- Automatic SRE Superpowers within your Kubernetes cluster☆376Updated this week
- Generates Kubernetes CRD API reference documentation☆135Updated this week
- Declarative Workflow of KubeVela which can run as standalone.☆120Updated last week
- A Go framework for end-to-end testing of components running in Kubernetes clusters.☆581Updated this week
- Cluster API Provider for Nested Clusters☆303Updated 9 months ago
- Example DRA driver that developers can fork and modify to get them started writing their own.☆74Updated last month