Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang source and land your first PR. Available in English and Chinese.
☆1,675Nov 1, 2026Updated this week
Alternatives and similar repositories for zero-to-sglang
Users that are interested in zero-to-sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,490May 17, 2026Updated 5 months ago
- High Performance Serving Runtime For Interactive Super Intelligence System☆1,665Updated this week
- 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验☆7,220Oct 1, 2026Updated last month
- Motivation-driven, visualization-first walkthrough of LLM inference, ending at why engines like SGLang exist☆23Updated this week
- My learning notes for ML SYS.☆7,628Oct 21, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Nano vLLM☆16,253Apr 26, 2026Updated 6 months ago
- 分享AI Infra知识&代码练习：PyTorch、vLLM/SGLang、slime/vime框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等☆4,295Sep 20, 2026Updated last month
- AI Infra 全栈从0入门学习资料：https://caomaolufei.github.io/AIInfraGuide/☆3,071Updated this week
- DeepInfer: High-performance, large-scale inference framework for DeepSeek models☆24,783Oct 26, 2026Updated last week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆38,342Updated this week
- An Open-source book with Modern CUDA learning Notes for Beginners - BF16/FP8/FP4, HGEMM, CuTe, Flash-Attention, etc.☆12,145Updated this week
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆1,099Aug 29, 2026Updated 2 months ago
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,946Updated this week
- A tutorial on modern GPU programming for machine learning systems☆1,376Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,247Updated this week
- 🚀 An open-source, hands-on curriculum bridging the gap from basic RL concepts to LLM alignment, RLVR, and advanced Agentic systems.☆4,836Oct 23, 2026Updated last week
- Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assig…☆2,618Updated this week
- 《C++设计模式》作者。创建AI Infra@学习圈，关注公众号《码出名企路》，家V《LiyiAngB》，一起做AI Infra企业级实战项目，互相学习。☆108Sep 12, 2026Updated last month
- Hello GPU：从 AMD GPU 架构、ROCm 工具链到 HIP/Triton 算子优化与单卡推理性能分析的实战教程。☆134Oct 24, 2026Updated last week
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,509Oct 19, 2026Updated 2 weeks ago
- High-performance RL post-training infrastructure. Designed to achieve bitwise operator-level train-inference consistency across heterogen…☆444Updated this week
- FlashInfer: Kernel Library for LLM Serving☆6,828Updated this week
- LLM algorithm practice lab with theory, solutions, and test cases.《大模型算法与系统教程》面向大模型入门到进阶的算法实战教程，覆盖原理讲解、答案解析、测试用例与 CUDA/Triton 实战。☆733Oct 25, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TokenSpeed is a speed-of-light LLM inference engine.☆2,841Updated this week
- ☆1,091Updated this week
- 从零开始学习AI Infra相关内容☆75Sep 9, 2026Updated last month
- learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen☆5,506Updated this week
- AIInfra（AI 基础设 施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。☆8,525Dec 22, 2025Updated 10 months ago
- Learn CUDA with PyTorch☆522Oct 3, 2026Updated 3 weeks ago
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,320Oct 17, 2026Updated 2 weeks ago
- 北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库☆254Aug 22, 2026Updated 2 months ago
- A framework for efficient model inference with omni-modality models☆7,463Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆174Mar 5, 2026Updated 7 months ago
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆8,867Updated this week
- slime is an LLM training framework for RL Scaling.☆8,774Updated this week
- how to optimize some algorithm in cuda.☆3,339Oct 11, 2026Updated 3 weeks ago
- AI Infra / 机器学习系统面经（305 题）☆48May 5, 2026Updated 5 months ago
- 🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Mod…☆4,456Jul 25, 2025Updated last year
- 📚 An educational, step-by-step implementation of LLM KV cache reuse — learn prefix caching, chunk keys, storage & eviction, from pure Py…☆25Updated this week