gpu-mode / awesomeMLSysLinks
An ML Systems Onboarding list
☆953Updated 10 months ago
Alternatives and similar repositories for awesomeMLSys
Users that are interested in awesomeMLSys are comparing it to the libraries listed below
Sorting:
- GPU programming related news and material links☆1,860Updated 3 months ago
- Puzzles for learning Triton☆2,170Updated last year
- A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.☆441Updated 9 months ago
- ☆404Updated 8 months ago
- Building blocks for foundation models.☆584Updated last year
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,917Updated 3 months ago
- 100 days of building GPU kernels!☆552Updated 7 months ago
- This repository is a curated collection of resources, tutorials, and practical examples designed to guide you through the journey of mast…☆427Updated 9 months ago
- Complete solutions to the Programming Massively Parallel Processors Edition 4☆602Updated 6 months ago
- Learnings and programs related to CUDA☆428Updated 5 months ago
- ☆767Updated this week
- Fast CUDA matrix multiplication from scratch☆979Updated 3 months ago
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆244Updated 7 months ago
- Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O☆539Updated 3 months ago
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆760Updated this week
- ☆203Updated last year
- What would you do with 1000 H100s...☆1,133Updated last year
- ☆227Updated 11 months ago
- ☆547Updated last year
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA (+ more DSLs)☆708Updated this week
- UNet diffusion model in pure CUDA☆656Updated last year
- Slides, notes, and materials for the workshop☆335Updated last year
- Material for gpu-mode lectures☆5,411Updated last week
- Flash Attention in ~100 lines of CUDA (forward pass only)☆1,015Updated 11 months ago
- Cataloging released Triton kernels.☆277Updated 3 months ago
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆828Updated 4 months ago
- High Quality Resources on GPU Programming/Architecture☆589Updated last year
- GPU Kernels☆210Updated 7 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆195Updated 6 months ago
- GPU documentation for humans☆416Updated last week