HuaizhengZhang / AI-Infra-from-Zero-to-HeroLinks
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
☆3,358Updated 3 months ago
Alternatives and similar repositories for AI-Infra-from-Zero-to-Hero
Users that are interested in AI-Infra-from-Zero-to-Hero are comparing it to the libraries listed below
Sorting:
- My learning notes/codes for ML SYS.☆4,012Updated 3 weeks ago
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆4,635Updated 2 months ago
- Large Language Model (LLM) Systems Paper List☆1,575Updated 2 weeks ago
- how to optimize some algorithm in cuda.☆2,575Updated last week
- System for AI Education Resource.☆4,157Updated last year
- compiler learning resources collect.☆2,563Updated 7 months ago
- 《Machine Learning Systems: Design and Implementation》- Chinese Version☆4,669Updated last year
- A list of awesome compiler projects and papers for tensor computation and deep learning.☆2,665Updated last year
- Material for gpu-mode lectures☆5,222Updated last month
- The road to hack SysML and become an system expert☆499Updated last year
- ☆609Updated 5 months ago
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆8,207Updated 2 weeks ago
- A self-learning tutorail for CUDA High Performance Programing.☆758Updated 4 months ago
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,518Updated 4 years ago
- ☆619Updated last year
- A curated list of awesome Distributed Deep Learning resources.☆431Updated last year
- Dive into Deep Learning Compiler☆646Updated 3 years ago
- DLRover: An Automatic Distributed Deep Learning System☆1,577Updated this week
- Learning material for CMU10-714: Deep Learning System☆279Updated last year
- Curated collection of papers in machine learning systems☆441Updated 3 weeks ago
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,173Updated 2 years ago
- A PyTorch Native LLM Training Framework☆879Updated last month
- Distributed Compiler based on Triton for Parallel Systems☆1,206Updated 2 weeks ago
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,226Updated 4 months ago
- Systems for ML/AI & ML/AI for Systems paper reading list: A curated reading list of computer science research for work at the intersectio…☆281Updated 4 months ago
- CS294; AI For Systems and Systems For AI☆226Updated 6 years ago
- A high performance and generic framework for distributed DNN training☆3,708Updated 2 years ago
- An ML Systems Onboarding list☆921Updated 9 months ago
- FlashInfer: Kernel Library for LLM Serving☆3,982Updated this week
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,839Updated last week