HuaizhengZhang / AI-Infra-from-Zero-to-HeroLinks
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
☆3,519Updated 5 months ago
Alternatives and similar repositories for AI-Infra-from-Zero-to-Hero
Users that are interested in AI-Infra-from-Zero-to-Hero are comparing it to the libraries listed below
Sorting:
- Large Language Model (LLM) Systems Paper List☆1,727Updated last week
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆4,876Updated last month
- My learning notes for ML SYS.☆4,848Updated last week
- how to optimize some algorithm in cuda.☆2,719Updated last week
- System for AI Education Resource.☆4,186Updated last year
- Material for gpu-mode lectures☆5,476Updated 3 weeks ago
- compiler learning resources collect.☆2,626Updated 9 months ago
- 《Machine Learning Systems: Design and Implementation》- Chinese Version☆4,727Updated last year
- A list of awesome compiler projects and papers for tensor computation and deep learning.☆2,703Updated last year
- ☆614Updated 7 months ago
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆9,098Updated last week
- The road to hack SysML and become an system expert☆505Updated last year
- A self-learning tutorail for CUDA High Performance Programing.☆794Updated 6 months ago
- Learning material for CMU10-714: Deep Learning System☆292Updated last year
- Tutorial code on how to build your own Deep Learning System in 2k Lines☆2,016Updated 7 years ago
- A curated list of awesome Distributed Deep Learning resources.☆435Updated last year
- An ML Systems Onboarding list☆960Updated 11 months ago
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,523Updated 4 years ago
- ☆2,312Updated 3 weeks ago
- Dive into Deep Learning Compiler☆646Updated 3 years ago
- A curated list for Efficient Large Language Models☆1,920Updated 6 months ago
- A high performance and generic framework for distributed DNN training☆3,715Updated 2 years ago
- ☆1,971Updated 2 years ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,212Updated 2 years ago
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,243Updated 6 months ago
- FlashInfer: Kernel Library for LLM Serving☆4,400Updated this week
- Curated collection of papers in machine learning systems☆489Updated 2 weeks ago
- Infrastructures™ for Machine Learning Training/Inference in Production.☆434Updated 6 years ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆2,709Updated this week
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆307Updated 11 months ago