envoyproxy / ai-gatewayLinks
Manages Unified Access to Generative AI Services built on Envoy Gateway
☆1,333Updated last week
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- eBPF-based Cloud Native Monitoring Tool☆1,055Updated last year
- Game Servers Management on Kubernetes☆1,048Updated this week
- Gateway API Inference Extension☆573Updated this week
- Specific Layer7 Gateway for kube-apiserver☆500Updated 3 months ago
- System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge☆3,017Updated this week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆286Updated last week
- 可以固定Pod/容器組IP地址的kubernetes網路輔助管理挿件。Kubernetes network management plug-in based on etcd storage can assign fixed IP for pod.☆254Updated 3 years ago
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆772Updated last week
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆654Updated last week
- Hwameistor is an HA local storage system for cloud-native stateful workloads.☆639Updated this week
- 一款轻量级、跨平台的 Mini Kubernetes AI Dashboard,支持大模型+智能体+MCP(支持设置操作权限),集成多集群管理、智能分析、实时异常检测等功能,支持多架构并可单文件部署,助力高效集群管理与运维优化。☆763Updated this week
- KubeFleet is an open-source Kubernetes multi-cluster application management solution.☆126Updated last week
- A chaos engineering platform for supporting the complete fault drill lifecycle.☆325Updated last year
- kom 是一个用于 Kubernetes 操作的工具,SDK级的kubectl、client-go的使用封装。并且支持作为管理k8s 的 MCP server。 它提供了一系列功能来管理 Kubernetes 资源,包括创建、更新、删除和获取资源,甚至使用SQL查询k8s资…☆142Updated this week
- Vanus is a Serverless, event streaming system with processing capabilities. It easily connects SaaS, Cloud Services, and Databases to he…☆1,698Updated last year
- High Performance Redis-API Compatible Distributed Database with Persistency, Scalability, Full ACID Transactions, and Tiered S3 Storage C…☆1,089Updated last week
- The `ztunnel` component of ambient mesh☆430Updated last week
- Next Generation Agentic Proxy for AI Agents and MCP servers☆1,629Updated this week
- Extending eBPF Programmability and Observability to GPUs (merged into https://github.com/eunomia-bpf/bpftime)☆288Updated 2 months ago
- JobSet: a k8s native API for distributed ML training and HPC workloads☆300Updated this week
- 🎉 An awesome & curated list of best LLMOps tools.☆184Updated 2 weeks ago
- Multi-Cluster Kubernetes Orchestration☆921Updated 5 months ago
- KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB…☆2,956Updated this week
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,095Updated this week
- Ultimate Context Engineering Infrastructure, starting from MCPs and Integrations☆798Updated 3 months ago
- GenAI inference performance benchmarking tool☆141Updated this week
- A secure, high-performance, multi-tenant micro-service platform for remote "App Management" and "Computing"☆211Updated last week
- Kubernetes-native AI serving platform for scalable model serving.☆173Updated this week
- HiMarket is an enterprise-level "AI Capability Marketplace and Developer Ecosystem Hub." It is not merely a simple aggregation of traditi…☆789Updated 2 weeks ago
- mcp client for Go (Golang). Integrate multiple Model Context Protocol (MCP) servers☆148Updated 4 months ago