HuaizhengZhang / AI-Infra-from-Zero-to-HeroLinks
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
☆3,584Updated 5 months ago
Alternatives and similar repositories for AI-Infra-from-Zero-to-Hero
Users that are interested in AI-Infra-from-Zero-to-Hero are comparing it to the libraries listed below
Sorting:
- My learning notes for ML SYS.☆5,077Updated last week
- compiler learning resources collect.☆2,663Updated 10 months ago
- how to optimize some algorithm in cuda.☆2,769Updated last week
- Material for gpu-mode lectures☆5,588Updated last month
- Large Language Model (LLM) Systems Paper List☆1,765Updated last week
- 《Machine Learning Systems: Design and Implementation》- Chinese Version☆4,743Updated last year
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆4,909Updated last month
- 📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉☆9,382Updated 2 weeks ago
- System for AI Education Resource.☆4,205Updated last year
- Learning material for CMU10-714: Deep Learning System☆296Updated last year
- A self-learning tutorail for CUDA High Performance Programing.☆838Updated last week
- The road to hack SysML and become an system expert☆510Updated last year
- ☆620Updated last week
- A curated list of awesome Distributed Deep Learning resources.☆437Updated last year
- A list of awesome compiler projects and papers for tensor computation and deep learning.☆2,717Updated last year
- Dive into Deep Learning Compiler☆645Updated 3 years ago
- An ML Systems Onboarding list☆972Updated last year
- This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several…☆1,222Updated 2 years ago
- Several simple examples for popular neural network toolkits calling custom CUDA operators.☆1,526Updated 4 years ago
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,854Updated last week
- The repository has collected a batch of noteworthy MLSys bloggers (Algorithms/Systems)☆315Updated last year
- ☆1,980Updated 2 years ago
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,249Updated 7 months ago
- Curated collection of papers in machine learning systems☆497Updated last month
- Infrastructures™ for Machine Learning Training/Inference in Production.☆439Updated 6 years ago
- ☆622Updated last month
- Byted PyTorch Distributed for Hyperscale Training of LLMs and RLs☆917Updated last month
- Distributed Compiler based on Triton for Parallel Systems☆1,315Updated 3 weeks ago
- FlashInfer: Kernel Library for LLM Serving☆4,707Updated this week
- Systems for ML/AI & ML/AI for Systems paper reading list: A curated reading list of computer science research for work at the intersectio…☆284Updated 7 months ago