knoway-dev / knoway
An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises
☆16Updated 3 months ago
Alternatives and similar repositories for knoway:
Users that are interested in knoway are comparing it to the libraries listed below
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆29Updated 3 months ago
- ☆12Updated 3 weeks ago
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12Updated last year
- d.run website☆14Updated last week
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆20Updated 3 months ago
- ☆12Updated last year
- IOMesh Helm Charts Repo☆14Updated 3 months ago
- Kubernetes APIServer 高性能代理组件,代理 APIServer 的 List 请求,其 它类型的请求会直接反向代理到原生 APIServer。 CKube 还额外支持了分页、搜索和索引等功能。 并且,CKube 100% 兼容原生 kubectl 和 ku…☆19Updated 2 years ago
- A comprehensive tool for etcd diagnosis☆25Updated this week
- ☆16Updated this week
- Dragonfly Helm Charts☆35Updated this week
- [Moved to https://github.com/kubernetes-sigs/kwok] fake-k8s is a tool for running Fake Kubernetes clusters, It can be used as an alternat…☆18Updated 2 years ago
- A QA system based on k8s-specific knowledge build on ChatGLM2-6B, serving by Ray.☆10Updated last year
- Visualize the configs of the Envoy☆79Updated last year
- GenAI inference performance benchmarking tool☆21Updated this week
- A network tunnel used to proxy Kubernetes API requests to member clusters☆16Updated 2 years ago
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆109Updated this week
- Following the same workflows as Kubernetes.☆11Updated 2 weeks ago
- caniuse.com, but for kubernetes☆23Updated 3 months ago
- Backend server for envd☆20Updated last year
- Batch-scheduler based on K8s scheduling framework, related features have contributed to scheduler-plugins(Deprecated).☆25Updated 4 years ago
- An OCM addon that automates the installation of Kubernetes' konnectivity servers and agents.☆47Updated this week
- A stress testing tool for the scheduler in a large-scale scenario.☆16Updated 11 months ago
- NVIDIA device plugin for Kubernetes☆15Updated 5 years ago
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆30Updated 3 weeks ago
- 🐶 CLI To Manage Your Istios In Style!☆23Updated 2 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆64Updated this week
- Resource Exporter for volcano scheduling, e.g. NUMA-Aware scheduling.☆16Updated 5 months ago
- The Volcano Descheduler☆13Updated 2 months ago
- Core API package for KubeVela https://github.com/kubevela/kubevela☆24Updated 3 weeks ago