cuda-mode / awesomeMLSys
An ML Systems Onboarding list
☆491Updated last month
Related projects: ⓘ
- CUDA related news and material links☆1,079Updated 2 weeks ago
- Puzzles for learning Triton☆966Updated this week
- UNet diffusion model in pure CUDA☆562Updated 2 months ago
- High Quality Resources on GPU Programming/Architecture☆561Updated last month
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆662Updated last month
- The Autograd Engine☆482Updated last week
- Alex Krizhevsky's original code from Google Code☆185Updated 8 years ago
- The Multilayer Perceptron Language Model☆503Updated last month
- The Tensor (or Array)☆388Updated last month
- Slides, notes, and materials for the workshop☆297Updated 3 months ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆452Updated last week
- Tile primitives for speedy kernels☆1,489Updated this week
- Material for cuda-mode lectures☆2,401Updated 2 weeks ago
- What would you do with 1000 H100s...☆816Updated 8 months ago
- LLM papers I'm reading, mostly on inference and model compression☆688Updated 8 months ago
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆165Updated last month
- nanoGPT style version of Llama 3.1☆1,162Updated last month
- System 2 Reasoning Link Collection☆597Updated this week
- Flash Attention in ~100 lines of CUDA (forward pass only)☆558Updated 5 months ago
- Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…☆1,131Updated this week
- Building blocks for foundation models.☆345Updated 8 months ago
- PyTorch native quantization and sparsity for training and inference☆726Updated this week
- Implementation of Diffusion Transformer (DiT) in JAX☆245Updated 3 months ago
- The n-gram Language Model☆1,288Updated last month
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆152Updated 11 months ago
- Simple Byte pair Encoding mechanism used for tokenization process . written purely in C☆115Updated 2 months ago
- A multi-level tensor algebra superoptimizer☆314Updated this week
- A native PyTorch Library for large model training☆1,544Updated this week
- ☆124Updated 7 months ago
- From zero to hero CUDA for accelerating maths and machine learning on GPU.☆167Updated last month