knoway-dev / knowayLinks
An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
☆24Updated 7 months ago
Alternatives and similar repositories for knoway
Users that are interested in knoway are comparing it to the libraries listed below
Sorting:
- 中国开发者活动日程(关注点:开源、开发者、云原生)☆22Updated this week
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆33Updated last week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆25Updated last year
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆57Updated 9 months ago
- Your AI Kubernetes Expert☆186Updated 2 years ago
- 🧘 Extensive LLM endpoints, expended capabilities through your favorite protocols, 🕸️ GraphQL, ↔️ gRPC, ♾️ WebSocket. Extended SOTA supp…☆18Updated this week
- Trace packets as they go through iptables chains☆69Updated last year
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated 2 years ago
- A benchmarking tool for comparing different LLM API providers' DeepSeek model deployments.☆30Updated 8 months ago
- d.run website☆15Updated last week
- IOMesh Helm Charts Repo☆14Updated last year
- A distributed system for Agentic AI☆32Updated last week
- Kubernetes-native AI serving platform for scalable model serving.☆92Updated this week
- A stress testing tool for the scheduler in a large-scale scenario.☆16Updated last year
- Backend server for envd☆22Updated last year
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated 2 years ago
- ALB (Another Load Balancer) is a Kubernetes Gateway powered by OpenResty with years of production experience from Alauda.☆68Updated 3 months ago
- Dragonfly Helm Charts☆42Updated last week
- A network packet info dumping tool like tcpdump based on `tc-bpf`.☆41Updated last year
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 3 years ago
- bpf(2)-based ftrace(1)-like function graph tracer for golang processes.☆31Updated 2 years ago
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆223Updated last week
- The Intelligent Inference Scheduler for Large-scale Inference Services.☆35Updated 2 weeks ago
- A network tunnel used to proxy Kubernetes API requests to member clusters☆15Updated 3 years ago
- init to record my learning path of AI Infra, especially on inference.☆99Updated last week
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆72Updated 4 months ago
- [Moved to https://github.com/kubernetes-sigs/kwok] fake-k8s is a tool for running Fake Kubernetes clusters, It can be used as an alternat…☆19Updated 2 years ago
- caniuse.com, but for kubernetes☆27Updated 11 months ago
- A comprehensive tool for etcd diagnosis☆31Updated last week
- API and go SDK for KubeBrain☆17Updated last year