HuaizhengZhang / AI-Infra-from-Zero-to-HeroLinks
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
☆3,223Updated last month
Alternatives and similar repositories for AI-Infra-from-Zero-to-Hero
Users that are interested in AI-Infra-from-Zero-to-Hero are comparing it to the libraries listed below
Sorting:
- Large Language Model (LLM) Systems Paper List☆1,467Updated this week
- A list of awesome compiler projects and papers for tensor computation and deep learning.☆2,633Updated 10 months ago
- My learning notes/codes for ML SYS.☆3,451Updated this week
- System for AI Education Resource.☆4,111Updated 10 months ago
- how to optimize some algorithm in cuda.☆2,428Updated last week
- compiler learning resources collect.☆2,497Updated 5 months ago
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆4,424Updated 2 weeks ago
- 《Machine Learning Systems: Design and Implementation》- Chinese Version☆4,578Updated last year
- ☆608Updated 3 months ago
- Material for gpu-mode lectures☆4,953Updated this week
- The road to hack SysML and become an system expert☆499Updated 11 months ago
- A curated list of awesome Distributed Deep Learning resources.☆430Updated last year
- An ML Systems Onboarding list☆880Updated 7 months ago
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆6,580Updated last week
- A self-learning tutorail for CUDA High Performance Programing.☆718Updated 2 months ago
- Learning material for CMU10-714: Deep Learning System☆272Updated last year
- ☆615Updated last year
- Dive into Deep Learning Compiler☆647Updated 3 years ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,135Updated 2 years ago
- ☆2,538Updated last year
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆270Updated 7 months ago
- Curated collection of papers in machine learning systems☆401Updated 2 months ago
- A high performance and generic framework for distributed DNN training☆3,697Updated last year
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,506Updated 4 years ago
- A PyTorch Native LLM Training Framework☆861Updated last month
- FlashInfer: Kernel Library for LLM Serving☆3,650Updated this week
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,203Updated 5 months ago
- how to learn PyTorch and OneFlow☆449Updated last year
- The full minitorch student suite.☆2,158Updated last year
- Infrastructures™ for Machine Learning Training/Inference in Production.☆425Updated 6 years ago