EleutherAI / cookbookLinks
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
☆829Updated 5 months ago
Alternatives and similar repositories for cookbook
Users that are interested in cookbook are comparing it to the libraries listed below
Sorting:
- What would you do with 1000 H100s...☆1,143Updated 2 years ago
- Best practices & guides on how to write distributed pytorch training code☆564Updated 2 months ago
- Puzzles for exploring transformers☆382Updated 2 years ago
- System 2 Reasoning Link Collection☆867Updated 10 months ago
- ☆552Updated last year
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆1,040Updated 8 months ago
- ☆538Updated 5 months ago
- Fast bare-bones BPE for modern tokenizer training☆175Updated 6 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,947Updated 4 months ago
- Minimalistic large language model 3D-parallelism training☆2,411Updated last month
- ☆463Updated last year
- A repository for research on medium sized language models.☆526Updated 7 months ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,304Updated last month
- Building blocks for foundation models.☆590Updated 2 years ago
- Atropos is a Language Model Reinforcement Learning Environments framework for collecting and evaluating LLM trajectories through diverse …☆825Updated this week
- Open-source framework for the research and development of foundation models.☆711Updated this week
- Annotated version of the Mamba paper☆494Updated last year
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆690Updated this week
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆939Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,123Updated 7 months ago
- UNet diffusion model in pure CUDA☆662Updated last year
- LLM papers I'm reading, mostly on inference and model compression☆750Updated 2 years ago
- Llama from scratch, or How to implement a paper without crying☆583Updated last year
- Website for hosting the Open Foundation Models Cheat Sheet.☆269Updated 8 months ago
- Best practices for distilling large language models.☆599Updated last year
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆355Updated last year
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆807Updated last week
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆576Updated 3 months ago
- Async RL Training at Scale☆1,005Updated this week
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆238Updated 5 months ago