envoyproxy / ai-gateway
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
☆100Updated this week
Alternatives and similar repositories for ai-gateway:
Users that are interested in ai-gateway are comparing it to the libraries listed below
- Gateway API Inference Extension☆129Updated this week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆177Updated this week
- All the things to make the scheduler extendable with wasm.☆113Updated last week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆175Updated this week
- Contains miscellaneous Wasm extensions for Istio☆112Updated 11 months ago
- This repository hosts the Multi-Cluster Service APIs. Providers can import packages in this repo to ensure their multi-cluster service co…☆218Updated this week
- Kubernetes Work API☆61Updated 2 months ago
- Libraries for implementing aggregated apiservers☆86Updated last week
- Example DRA driver that developers can fork and modify to get them started writing their own.☆57Updated last week
- Multi-cluster api gateway based on apiserver-aggregation.☆95Updated last month
- Generates Kubernetes CRD API reference documentation☆111Updated last week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆25Updated last month
- [EOL] Reworking kube-proxy's architecture☆246Updated 6 months ago
- A Knative ingress controller for Istio.☆76Updated this week
- CAPK is a provider for Cluster API (CAPI) that allows users to deploy fake, Kubemark-backed machines to their clusters.☆65Updated last week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆59Updated this week
- A template project for writing your own controller using the Knative helper libraries.☆72Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆53Updated this week
- Generic libraries for building idiomatic Kubernetes controllers☆183Updated last week
- WG Serving☆19Updated 3 weeks ago
- ☆48Updated 10 months ago
- Deploys many lightweight XDS clients to generate load on an XDS server (Pilot)☆39Updated 2 weeks ago
- Combined operator for Knative.☆193Updated this week
- K8s device plugin for GPU sharing☆99Updated last year
- ☆96Updated last month
- Smart Kubernetes Scheduling☆73Updated this week
- InstaSlice Operator facilitates slicing of accelerators using stable APIs☆27Updated this week
- [Moved to https://github.com/kubernetes-sigs/kwok] This is a fake kubelet. that can simulate any number of nodes and maintain pods on tho…☆63Updated 2 years ago
- A benchmarking tool to evaluate Knative performance☆37Updated last year
- Kubetest2 is the framework for launching and running end-to-end tests on Kubernetes.☆344Updated last month