EleutherAI / cookbook
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
☆784Updated last month
Alternatives and similar repositories for cookbook:
Users that are interested in cookbook are comparing it to the libraries listed below
- What would you do with 1000 H100s...☆1,035Updated last year
- Best practices & guides on how to write distributed pytorch training code☆401Updated last month
- Minimalistic 4D-parallelism distributed training framework for education purpose☆991Updated last month
- Puzzles for exploring transformers☆343Updated last year
- A bibliography and survey of the papers surrounding o1☆1,187Updated 5 months ago
- Textbook on reinforcement learning from human feedback☆605Updated this week
- Minimalistic large language model 3D-parallelism training☆1,793Updated this week
- System 2 Reasoning Link Collection☆826Updated last month
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,438Updated this week
- ☆423Updated 9 months ago
- Sparsify transformers with SAEs and transcoders☆519Updated this week
- Puzzles for learning Triton☆1,577Updated 5 months ago
- Best practices for distilling large language models.☆523Updated last year
- Building blocks for foundation models.☆483Updated last year
- The Tensor (or Array)☆429Updated 8 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆862Updated 2 months ago
- Fast bare-bones BPE for modern tokenizer training☆154Updated 2 weeks ago
- ☆428Updated 6 months ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆209Updated last year
- procedural reasoning datasets☆565Updated this week
- An extension of the nanoGPT repository for training small MOE models.☆129Updated last month
- ☆166Updated 2 months ago
- A comprehensive deep dive into the world of tokens☆221Updated 9 months ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆1,002Updated 2 months ago
- ☆512Updated 5 months ago
- A puzzle to learn about prompting☆127Updated last year
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆530Updated this week
- Implementing DeepSeek R1's GRPO algorithm from scratch☆445Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,360Updated this week
- Open weights language model from Google DeepMind, based on Griffin.☆636Updated 2 months ago