EleutherAI / cookbookLinks
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
☆801Updated last month
Alternatives and similar repositories for cookbook
Users that are interested in cookbook are comparing it to the libraries listed below
Sorting:
- What would you do with 1000 H100s...☆1,061Updated last year
- Best practices & guides on how to write distributed pytorch training code☆444Updated 4 months ago
- ☆511Updated last year
- Puzzles for exploring transformers☆354Updated 2 years ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆1,022Updated 2 months ago
- System 2 Reasoning Link Collection☆841Updated 3 months ago
- ☆440Updated 8 months ago
- Fast bare-bones BPE for modern tokenizer training☆159Updated 2 weeks ago
- Minimalistic large language model 3D-parallelism training☆2,012Updated this week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,566Updated last month
- procedural reasoning datasets☆938Updated this week
- Building blocks for foundation models.☆515Updated last year
- ☆604Updated last week
- The Tensor (or Array)☆437Updated 11 months ago
- The Autograd Engine☆620Updated 10 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆497Updated this week
- A bibliography and survey of the papers surrounding o1☆1,205Updated 7 months ago
- The Multilayer Perceptron Language Model☆553Updated 11 months ago
- UNet diffusion model in pure CUDA☆610Updated last year
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆888Updated 2 months ago
- Website for hosting the Open Foundation Models Cheat Sheet.☆267Updated 2 months ago
- Llama from scratch, or How to implement a paper without crying☆571Updated last year
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆217Updated last year
- Puzzles for learning Triton☆1,747Updated 7 months ago
- A repository for research on medium sized language models.☆502Updated last month
- A comprehensive deep dive into the world of tokens☆224Updated last year
- Best practices for distilling large language models.☆561Updated last year
- A puzzle to learn about prompting☆130Updated 2 years ago
- Sparsify transformers with SAEs and transcoders☆583Updated this week
- Following master Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆173Updated 11 months ago