skyzh / tiny-llmLinks
A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.
☆3,562Updated last week
Alternatives and similar repositories for tiny-llm
Users that are interested in tiny-llm are comparing it to the libraries listed below
Sorting:
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆2,381Updated this week
- Nano vLLM☆10,118Updated last month
- Supercharge Your LLM with the Fastest KV Cache Layer☆6,451Updated this week
- My learning notes for ML SYS.☆4,783Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆4,471Updated this week
- Implementing DeepSeek R1's GRPO algorithm from scratch☆1,718Updated 8 months ago
- Large Language Model (LLM) Systems Paper List☆1,709Updated this week
- ☆2,281Updated 3 weeks ago
- Mirage Persistent Kernel: Compiling LLMs into a MegaKernel☆2,004Updated last week
- A Datacenter Scale Distributed Inference Serving Framework☆5,673Updated this week
- slime is an LLM post-training framework for RL Scaling.☆3,022Updated this week
- Textbook on reinforcement learning from human feedback☆1,364Updated this week
- Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation☆7,947Updated 7 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,928Updated 4 months ago
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆2,050Updated last week
- Achieve the llama3 inference step-by-step, grasp the core concepts, master the process derivation, implement the code.☆613Updated 10 months ago
- FlashInfer: Kernel Library for LLM Serving☆4,354Updated this week
- A Vector Database Tutorial (over CMU-DB's BusTub system)☆740Updated 11 months ago
- Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch☆1,026Updated 3 months ago
- An ML Systems Onboarding list☆958Updated 11 months ago
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆542Updated 3 months ago
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆4,289Updated this week
- Democratizing Reinforcement Learning for LLMs☆4,896Updated last week
- A self-learning tutorail for CUDA High Performance Programing.☆791Updated 5 months ago
- MoBA: Mixture of Block Attention for Long-Context LLMs☆2,022Updated 8 months ago
- Awesome Reasoning LLM Tutorial/Survey/Guide☆2,221Updated 2 months ago
- Everything about the SmolLM and SmolVLM family of models☆3,499Updated last month
- Puzzles for learning Triton☆2,187Updated last year
- Renderer for the harmony response format to be used with gpt-oss☆4,096Updated last week
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆307Updated 11 months ago