knoway-dev / knowayLinks
An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
☆20Updated 2 months ago
Alternatives and similar repositories for knoway
Users that are interested in knoway are comparing it to the libraries listed below
Sorting:
- init to record my learning path of AI Infra, especially on inference.☆34Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆30Updated last week
- 中国开发者活动日程(关注点:开源、开发者、云原生)☆16Updated last week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆48Updated 4 months ago
- 🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA supp…☆16Updated this week
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆196Updated this week
- d.run website☆16Updated last week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- ☆17Updated this week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 7 months ago
- Trace packets as they go through iptables chains☆66Updated 9 months ago
- ☆12Updated 2 years ago
- IOMesh Helm Charts Repo☆14Updated 7 months ago
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- A comprehensive tool for etcd diagnosis☆25Updated 2 weeks ago
- caniuse.com, but for kubernetes☆24Updated 6 months ago
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated last year
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆30Updated this week
- 🐳🧩 Easy to use MCP builder & launcher for all possible MCP servers, just like Ollama for models!☆21Updated 2 months ago
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆65Updated 2 weeks ago
- Your AI Kubernetes Expert☆183Updated 2 years ago
- A network tunnel used to proxy Kubernetes API requests to member clusters☆16Updated 3 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆68Updated 2 months ago
- Manage K8S like managing local files☆29Updated 2 years ago
- Distributed KV cache coordinator☆43Updated last week
- A diverse, simple, and secure all-in-one LLMOps platform☆107Updated 9 months ago
- A stress testing tool for the scheduler in a large-scale scenario.☆15Updated last year
- Dragonfly Helm Charts☆38Updated this week
- Visualize the configs of the Envoy☆82Updated last year
- OpenCIDN (Open Container Image Deliver Network)☆27Updated 3 weeks ago