envoyproxy / ai-gatewayLinks
Manages Unified Access to Generative AI Services built on Envoy Gateway
☆1,366Updated this week
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Game Servers Management on Kubernetes☆1,049Updated 2 weeks ago
- eBPF-based Cloud Native Monitoring Tool☆1,055Updated last year
- System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge☆3,149Updated this week
- Gateway API Inference Extension☆576Updated this week
- Specific Layer7 Gateway for kube-apiserver☆500Updated 4 months ago
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆875Updated this week
- 可以固定Pod/容器組IP地址的kubernetes網路輔助管理挿件。Kubernetes network management plug-in based on etcd storage can assign fixed IP for pod.☆254Updated 3 years ago
- KubeFleet is an open-source Kubernetes multi-cluster application management solution.☆131Updated this week
- 一款轻量级、跨平台的 Mini Kubernetes AI Dashboard，支持大模型+智能体+MCP(支持设置操作权限)，集成多集群管理、智能分析、实时异常检测等功能，支持多架构并可单文件部署，助力高效集群管理与运维优化。☆777Updated last week
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆287Updated 2 weeks ago
- LeaderWorkerSet: An API for deploying a group of pods as a unit of replication☆662Updated last week
- Kubernetes-native AI serving platform for scalable model serving.☆208Updated this week
- High Performance Redis-API Compatible Distributed Database with Persistency, Scalability, Full ACID Transactions, and Tiered S3 Storage C…☆1,153Updated this week
- KubeBlocks is a Kubernetes Operator designed to manage a variety of databases and streaming systems, including MySQL, PostgreSQL, MongoDB…☆2,977Updated this week
- JobSet: a k8s native API for distributed ML training and HPC workloads☆308Updated this week
- Hwameistor is an HA local storage system for cloud-native stateful workloads.☆640Updated last week
- CLI tool and Kubernetes Controller for building, testing and deploying MCP servers☆417Updated last week
- kom 是一个用于 Kubernetes 操作的工具，SDK级的kubectl、client-go的使用封装。并且支持作为管理k8s 的 MCP server。 它提供了一系列功能来管理 Kubernetes 资源，包括创建、更新、删除和获取资源，甚至使用SQL查询k8s资…☆142Updated 2 weeks ago
- Cloud Native Agentic AI | Discord: https://bit.ly/kagentdiscord☆2,155Updated this week
- 🎉 An awesome & curated list of best LLMOps tools.☆190Updated this week
- A secure, high-performance, multi-tenant micro-service platform for remote "App Management" and "Computing"☆211Updated this week
- HiMarket is an enterprise-level "AI Capability Marketplace and Developer Ecosystem Hub." It is not merely a simple aggregation of traditi…☆875Updated this week
- Multi-Cluster Kubernetes Orchestration☆921Updated 5 months ago
- ☆191Updated 3 weeks ago
- Rapid and cost-effective operator and best practice for agent sandbox lifecycle management.☆106Updated this week
- AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-te…☆1,147Updated this week
- Next Generation Agentic Proxy for AI Agents and MCP servers☆1,727Updated this week
- mcp client for Go (Golang). Integrate multiple Model Context Protocol (MCP) servers☆149Updated 5 months ago
- KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale☆1,111Updated this week
- K8s-mcp-server is a Model Context Protocol (MCP) server that enables AI assistants like Claude to securely execute Kubernetes commands. I…☆181Updated 9 months ago