init to record my learning path of AI Infra, especially on inference.
☆147Mar 6, 2026Updated this week
Alternatives and similar repositories for AI-Infra
Users that are interested in AI-Infra are comparing it to the libraries listed below
Sorting:
- Following the same workflows as Kubernetes. Widely used in InftyAI community.☆13Dec 5, 2025Updated 3 months ago
- 中国开发者活动日程（关注点：开源、开发者、云原生）☆23Feb 25, 2026Updated last week
- ☆20Feb 19, 2026Updated 2 weeks ago
- 🧯 Kubernetes coverage for fault awareness and recovery, works for any LLMOps, MLOps, AI workloads.☆35Updated this week
- This project is designed to simulate GPU information, making it easier to test scenarios where a GPU is not available.☆65Jan 9, 2026Updated last month
- An Envoy inspired, ultimate LLM-first gateway for LLM serving and downstream application developers and enterprises☆26Apr 24, 2025Updated 10 months ago
- Simplified Data Management and Sharing for Kubernetes☆17Updated this week
- The main purpose of runtime copilot is to assist with node runtime management tasks such as configuring registries, upgrading versions, i…☆12May 16, 2023Updated 2 years ago
- caniuse.com, but for kubernetes☆27Dec 25, 2024Updated last year
- d.run website☆15Feb 26, 2026Updated last week
- PLEASE NOTE: This role has been migrated to our hifis.toolkit collection. A role to set up Keepalived in a high availability and scalab…☆13May 22, 2024Updated last year
- Running and managing Wasm(actors) and capability providers in Kubernetes☆31Dec 12, 2023Updated 2 years ago
- 围绕云原生知识体系，收集一些不错的文章。仅供学习参考。☆53Jul 11, 2022Updated 3 years ago
- Large language model fine-tuning capabilities based on cloud native and distributed computing.☆92Feb 22, 2024Updated 2 years ago
- kata 安全容器相关笔记，原理实战，开发进阶☆33Feb 25, 2024Updated 2 years ago
- ☆14Oct 21, 2023Updated 2 years ago
- Collect Repos Star/Fork/Watch Counts Everyday☆17Feb 23, 2026Updated last week
- 🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫☆234Updated this week
- Test Environment Booking tool☆14Nov 16, 2020Updated 5 years ago
- ☆18Jun 2, 2022Updated 3 years ago
- SLO-aware Kubernetes scheduler for the Edge and Cloud☆15Apr 28, 2023Updated 2 years ago
- Command-line tools for managing OCI model artifacts, which are bundled based on Model Spec☆62Feb 28, 2026Updated last week
- Download kubernetes binaries more easily☆121Updated this week
- The Intelligent Inference Scheduler for Large-scale Inference Services.☆64Feb 12, 2026Updated 3 weeks ago
- Kubernetes LTS(long term support)☆216Dec 24, 2024Updated last year
- ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!☆293Jan 26, 2026Updated last month
- How query engine work golang port for learning purpose☆23Dec 25, 2021Updated 4 years ago
- Manage kubernetes node-level kernel tuning ( using sysctl ).☆30Nov 21, 2025Updated 3 months ago
- MirageDebug: Local remote debugging for Kubernetes apps, enabling fully authentic environment debugging.☆56May 27, 2024Updated last year
- RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderb…☆70Feb 18, 2026Updated 2 weeks ago
- A comprehensive tool for etcd diagnosis☆34Feb 16, 2026Updated 2 weeks ago
- WG Serving☆34Dec 15, 2025Updated 2 months ago
- 💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSI…☆26Dec 6, 2024Updated last year
- An open-source SSH and Kubernetes configuration management tool designed for macOS users.☆41Aug 25, 2025Updated 6 months ago
- A Cloud-Native Service Catalog and Full Lifecycle Management Platform accross Multi-cloud and Edge☆32Sep 28, 2023Updated 2 years ago
- knavigator is a development, testing, and optimization toolkit for AI/ML scheduling systems at scale on Kubernetes.☆74Jul 18, 2025Updated 7 months ago
- vcjob Orchestruating Engine☆30Aug 18, 2022Updated 3 years ago
- Experimental DRA driver bringing CNI closer to Kubernetes☆39Oct 1, 2025Updated 5 months ago
- ☆47Dec 8, 2025Updated 2 months ago