HuaizhengZhang / AI-Infra-from-Zero-to-HeroLinks
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
☆3,283Updated last month
Alternatives and similar repositories for AI-Infra-from-Zero-to-Hero
Users that are interested in AI-Infra-from-Zero-to-Hero are comparing it to the libraries listed below
Sorting:
- how to optimize some algorithm in cuda.☆2,505Updated last week
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆4,541Updated last month
- Large Language Model (LLM) Systems Paper List☆1,503Updated this week
- compiler learning resources collect.☆2,523Updated 6 months ago
- Material for gpu-mode lectures☆5,049Updated last week
- 《Machine Learning Systems: Design and Implementation》- Chinese Version☆4,625Updated last year
- My learning notes/codes for ML SYS.☆3,632Updated this week
- A list of awesome compiler projects and papers for tensor computation and deep learning.☆2,649Updated 11 months ago
- The road to hack SysML and become an system expert☆499Updated 11 months ago
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆6,935Updated last week
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,512Updated 4 years ago
- A self-learning tutorail for CUDA High Performance Programing.☆740Updated 2 months ago
- Learning material for CMU10-714: Deep Learning System☆276Updated last year
- System for AI Education Resource.☆4,130Updated 10 months ago
- Tutorial code on how to build your own Deep Learning System in 2k Lines☆2,018Updated 6 years ago
- ☆608Updated 4 months ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,148Updated 2 years ago
- Dive into Deep Learning Compiler☆647Updated 3 years ago
- A curated list of awesome Distributed Deep Learning resources.☆431Updated last year
- Curated collection of papers in machine learning systems☆413Updated 3 weeks ago
- A high performance and generic framework for distributed DNN training☆3,702Updated last year
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,214Updated 3 months ago
- Infrastructures™ for Machine Learning Training/Inference in Production.☆426Updated 6 years ago
- ☆616Updated last year
- CS294; AI For Systems and Systems For AI☆225Updated 6 years ago
- FlashInfer: Kernel Library for LLM Serving☆3,761Updated this week
- A curated list for Efficient Large Language Models☆1,867Updated 3 months ago
- An ML Systems Onboarding list☆900Updated 7 months ago
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆277Updated 8 months ago
- how to learn PyTorch and OneFlow☆453Updated last year