What would you do with 1000 H100s...
☆1,161Jan 10, 2024Updated 2 years ago
Alternatives and similar repositories for LLM-Training-Puzzles
Users that are interested in LLM-Training-Puzzles are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Puzzles for exploring transformers☆387May 4, 2023Updated 2 years ago
- ☆498Oct 18, 2024Updated last year
- A puzzle to learn about prompting☆136May 12, 2023Updated 2 years ago
- Solve puzzles. Improve your pytorch.☆3,985Jul 15, 2024Updated last year
- Puzzles for learning Triton☆2,336Updated this week
- Solve puzzles. Learn CUDA.☆12,007Sep 1, 2024Updated last year
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,116Aug 26, 2025Updated 6 months ago
- Annotated version of the Mamba paper☆499Feb 27, 2024Updated 2 years ago
- GPU programming related news and material links☆2,047Mar 8, 2026Updated 2 weeks ago
- A PyTorch native platform for training generative AI models☆5,162Updated this week
- Minimalistic large language model 3D-parallelism training☆2,617Feb 19, 2026Updated last month
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,187Aug 22, 2025Updated 7 months ago
- Machine Learning Engineering Open Book☆17,440Mar 16, 2026Updated last week
- Deep learning for dummies. All the practical details and useful utilities that go into working with real models.☆836Mar 15, 2026Updated last week
- Tile primitives for speedy kernels☆3,232Updated this week
- 🚀 Efficient implementations of state-of-the-art linear attention models☆4,630Updated this week
- A bibliography and survey of the papers surrounding o1☆1,212Nov 16, 2024Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆699Jan 26, 2026Updated last month
- Implementation of https://srush.github.io/annotated-s4☆513Jun 20, 2025Updated 9 months ago
- Efficient Triton Kernels for LLM Training☆6,216Updated this week
- Experiment of using Tangent to autodiff triton☆82Jan 22, 2024Updated 2 years ago
- A simple, performant and scalable Jax LLM!☆2,182Updated this week
- ☆22Apr 22, 2024Updated last year
- Development repository for the Triton language and compiler☆18,708Updated this week
- ☆92Jul 5, 2024Updated last year
- Ring attention implementation with flash attention☆996Sep 10, 2025Updated 6 months ago
- Accessible large language models via k-bit quantization for PyTorch.☆8,052Updated this week
- Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.☆4,757Jul 18, 2025Updated 8 months ago
- ☆4,112Jun 4, 2024Updated last year
- Fast and memory-efficient exact attention☆22,832Updated this week
- A tiny library for coding with large language models.☆1,233Jul 10, 2024Updated last year
- Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackab…☆1,585Jan 28, 2026Updated last month
- Material for gpu-mode lectures☆5,865Feb 1, 2026Updated last month
- ☆570Jul 11, 2024Updated last year
- ☆307Updated this week
- FlashInfer: Kernel Library for LLM Serving☆5,194Updated this week
- Robust recipes to align language models with human and AI preferences☆5,527Sep 8, 2025Updated 6 months ago
- ☆317Jun 21, 2024Updated last year
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,373Updated this week