a personal collection of my notes for ml sys
☆128Oct 26, 2026Updated 3 weeks ago
Alternatives and similar repositories for ml-systems-notes
Users that are interested in ml-systems-notes are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a LLM inference engine to run on consumer hardware☆49Apr 15, 2026Updated 7 months ago
- From-scratch multi-GPU LLM inference engine: paged KV cache, continuous batching, prefix caching, tensor parallelism, OpenAI-compatible s…☆28Sep 25, 2026Updated last month
- Repository for GPU related kernels for learning/testing purposes☆21May 27, 2026Updated 5 months ago
- A GPT-2 inference engine written from scratch in CUDA and C++. Implements custom CUDA kernels for tiled matrix multiplication, LayerNorm,…☆44May 17, 2026Updated 5 months ago
- ☆20Apr 26, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- a guide to learn and implement inference techniques from scratch☆14Jun 18, 2026Updated 4 months ago
- A Python DSL for Apple Metal GPU compute☆27Jul 23, 2026Updated 3 months ago
- a minimal paged attention implementation☆20Jan 30, 2026Updated 9 months ago
- Deployment & experimentation of LLM inference at production scale (P/D disaggregation, KV offloading, parallelism, and autoscaling).☆65Sep 26, 2026Updated last month
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,369Oct 17, 2026Updated 3 weeks ago
- A curated resource list for learning post training☆22Oct 11, 2026Updated last month
- A distributed training framework based on torchtitan☆112Aug 17, 2026Updated 2 months ago
- A custom LSM-tree based storage engine built in Java featuring WAL durability, Memtables, SSTables, Bloom Filters, sparse indexing, and b…☆20Aug 31, 2026Updated 2 months ago
- [MLSys 26] 🥇 Solution for Gated Delta Net Track of MLSys 26 Flash infer competition☆38May 22, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Learning notes for understanding modern Machine Learning System.☆66Updated this week
- cpu inference for ternary neural nets. no deps. just c++ and simd.☆23Oct 18, 2026Updated 3 weeks ago
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,925Apr 30, 2026Updated 6 months ago
- 笔记整理 Skill:一个用于 Claude Code 的课程资料、PDF、PPT、题库整理成 Markdown/Obsidian 复习笔记的 Claude Skill。☆17Jun 30, 2026Updated 4 months ago
- ☆17Oct 18, 2026Updated 3 weeks ago
- Educational distributed training and inference library for heterogeneous local hardware: Mac minis, Raspberry Pis and GPUs over plain Pyt…☆90Oct 7, 2026Updated last month
- everything you need to know about inference engineering☆45Sep 29, 2026Updated last month
- MICCAI 25 Publication: Your other Left! Vision-Language Models Fail to Identify Relative Positions in Medical Images☆16Aug 1, 2026Updated 3 months ago
- ☆136Dec 9, 2025Updated 11 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆90Dec 16, 2025Updated 10 months ago
- Curated collection of AI inference engineering resources — LLM serving, GPU kernels, quantization, distributed inference, and production …☆373Feb 4, 2026Updated 9 months ago
- ☆25Apr 4, 2026Updated 7 months ago
- turboquant-based compression engine for LLM KV cache☆60Apr 3, 2026Updated 7 months ago
- From-scratch PyTorch replications of classic and SOTA AI/ML papers: transformers, attention, GANs, diffusion, CLIP, LoRA, MoE, plus SFT/G…☆430Nov 4, 2026Updated last week
- A kernel visualization that walks through each step of the code.☆14Aug 1, 2026Updated 3 months ago
- Write a fast kernel and see how you compare against the best humans and AI on gpumode.com☆123Nov 5, 2026Updated last week
- Course on Flash-attention in Triton☆103Feb 9, 2026Updated 9 months ago
- ☆51Aug 17, 2026Updated 2 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Awesome Aviation resources☆14Jun 21, 2026Updated 4 months ago
- Quantized LLM training in pure CUDA/C++.☆267Updated this week
- A Curated Collection of Frontier Language Model Architectures☆14Jan 30, 2026Updated 9 months ago
- ✨ AI/ML Research☆457Updated this week
- 《汇编语言一发入魂》配套代码☆15May 30, 2020Updated 6 years ago
- GEMMs with metal☆27Nov 1, 2026Updated 2 weeks ago
- B200 Attention from Scratch: understand one of the hardest GPU kernels on the latest hardware☆103Oct 9, 2026Updated last month
Are these results useful?