knoway-dev / knowayLinks
An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
☆23Updated 4 months ago
Alternatives and similar repositories for knoway
Users that are interested in knoway are comparing it to the libraries listed below
Sorting:
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆32Updated 2 weeks ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆50Updated 5 months ago
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆18Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆24Updated 8 months ago
- d.run website☆16Updated this week
- Trace packets as they go through iptables chains☆67Updated 11 months ago
- Your AI Kubernetes Expert☆184Updated 2 years ago
- init to record my learning path of AI Infra, especially on inference.☆73Updated this week
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆208Updated this week
- Kubernetes APIServer 高性能代理组件，代理 APIServer 的 List 请求，其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且，CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆69Updated last month
- Dragonfly Helm Charts☆39Updated this week
- ☆17Updated last week
- A network tunnel used to proxy Kubernetes API requests to member clusters☆16Updated 3 years ago
- [Moved to https://github.com/kubernetes-sigs/kwok] fake-k8s is a tool for running Fake Kubernetes clusters, It can be used as an alternat…☆18Updated 2 years ago
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆65Updated last month
- caniuse.com, but for kubernetes☆25Updated 8 months ago
- IOMesh Helm Charts Repo☆14Updated 8 months ago
- A distributed engine for elastic workload, e.g. AI Agent, Quant☆29Updated last week
- A comprehensive tool for etcd diagnosis☆25Updated this week
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆34Updated this week
- agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.☆14Updated last week
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated last year
- Backend server for envd☆21Updated last year
- Collect Repos Star/Fork/Watch Counts Everyday☆16Updated this week
- 🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA supp…☆19Updated this week
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆14Updated last month
- Visualize the configs of the Envoy☆83Updated 2 years ago
- Manage kubernetes node-level kernel tuning ( using sysctl ).☆28Updated 2 weeks ago