envoyproxy / ai-gatewayLinks
Manages Unified Access to Generative AI Services built on Envoy Gateway
☆1,303Updated last week
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Game Servers Management on Kubernetes☆1,047Updated last month
- eBPF-based Cloud Native Monitoring Tool☆1,055Updated last year
- System Level Intelligent Router for Mixture-of-Models☆2,674Updated this week
- Gateway API Inference Extension☆559Updated this week
- Specific Layer7 Gateway for kube-apiserver☆501Updated 3 months ago
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆618Updated last week
- 可以固定Pod/容器組IP地址的kubernetes網路輔助管理挿件。Kubernetes network management plug-in based on etcd storage can assign fixed IP for pod.☆254Updated 3 years ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆284Updated 3 weeks ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆645Updated 2 weeks ago
- Hwameistor is an HA local storage system for cloud-native stateful workloads.☆635Updated this week
- 一款轻量级、跨平台的 Mini Kubernetes AI Dashboard，支持大模型+智能体+MCP(支持设置操作权限)，集成多集群管理、智能分析、实时异常检测等功能，支持多架构并可单文件部署，助力高效集群管理与运维优化。☆751Updated this week
- Kubernetes-native AI serving platform for scalable model serving.☆154Updated this week
- kom 是一个用于 Kubernetes 操作的工具，SDK级的kubectl、client-go的使用封装。并且支持作为管理k8s 的 MCP server。 它提供了一系列功能来管理 Kubernetes 资源，包括创建、更新、删除和获取资源，甚至使用SQL查询k8s资…☆141Updated 2 weeks ago
- JobSet: a k8s native API for distributed ML training and HPC workloads☆296Updated last week
- KubeFleet is an open-source Kubernetes multi-cluster application management solution.☆123Updated last week
- High Performance Redis-API Compatible Distributed Database with Persistency, Scalability, Full ACID Transactions, and Tiered S3 Storage C…☆931Updated this week
- 🎉 An awesome & curated list of best LLMOps tools.☆181Updated last week
- A chaos engineering platform for supporting the complete fault drill lifecycle.☆326Updated last year
- Rapid and cost-effective operator and best practice for agent sandbox lifecycle management.☆53Updated this week
- A cloud native, micro-service application management platform with high performance, security and multi-tenant support☆212Updated this week
- CLI tool and Kubernetes Controller for building, testing and deploying MCP servers☆401Updated last month
- mcp client for Go (Golang). Integrate multiple Model Context Protocol (MCP) servers☆149Updated 4 months ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,059Updated this week
- Vanus is a Serverless, event streaming system with processing capabilities. It easily connects SaaS, Cloud Services, and Databases to he…☆1,703Updated last year
- Cloud Native Artifacial Intelligence Model Format Specification☆166Updated this week
- KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB…☆2,943Updated this week
- Extending eBPF Programmability and Observability to GPUs (merged into https://github.com/eunomia-bpf/bpftime)☆284Updated last month
- Ultimate Context Engineering Infrastructure, starting from MCPs and Integrations☆799Updated 2 months ago
- Fully elastic, MongoDB API compatible distributed JSON document database with compute-storage separation and robust ACID transactions.☆748Updated this week
- a unified scheduler for online and offline tasks☆639Updated 9 months ago