srush / Triton-Puzzles
Puzzles for learning Triton
☆966Updated this week
Related projects: ⓘ
- Tile primitives for speedy kernels☆1,489Updated this week
- What would you do with 1000 H100s...☆816Updated 8 months ago
- CUDA related news and material links☆1,079Updated 2 weeks ago
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆452Updated last week
- Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors a…☆1,131Updated this week
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆662Updated last month
- Flash Attention in ~100 lines of CUDA (forward pass only)☆558Updated 5 months ago
- PyTorch native quantization and sparsity for training and inference☆726Updated this week
- UNet diffusion model in pure CUDA☆562Updated 2 months ago
- Building blocks for foundation models.☆345Updated 8 months ago
- Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton☆1,190Updated this week
- An ML Systems Onboarding list☆491Updated last month
- Schedule-Free Optimization in PyTorch☆1,800Updated last month
- Open weights language model from Google DeepMind, based on Griffin.☆592Updated 2 months ago
- Puzzles for exploring transformers☆293Updated last year
- A native PyTorch Library for large model training☆1,544Updated this week
- A JAX research toolkit for building, editing, and visualizing neural networks.☆1,638Updated last week
- TensorDict is a pytorch dedicated tensor container.☆807Updated this week
- Minimalistic large language model 3D-parallelism training☆1,111Updated this week
- Annotated version of the Mamba paper☆445Updated 6 months ago
- ☆325Updated 11 months ago
- A multi-level tensor algebra superoptimizer☆314Updated this week
- Helpful tools and examples for working with flex-attention☆341Updated last month
- Pipeline Parallelism for PyTorch☆708Updated 3 weeks ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆492Updated this week
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆451Updated last month
- ☆1,164Updated last week
- ☆201Updated 2 months ago
- The Tensor (or Array)☆388Updated last month
- An open-source efficient deep learning framework/compiler, written in python.☆646Updated 3 weeks ago