EleutherAI / cookbookLinks
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
☆829Updated 6 months ago
Alternatives and similar repositories for cookbook
Users that are interested in cookbook are comparing it to the libraries listed below
Sorting:
- What would you do with 1000 H100s...☆1,151Updated 2 years ago
- Best practices & guides on how to write distributed pytorch training code☆575Updated 3 months ago
- Puzzles for exploring transformers☆386Updated 2 years ago
- ☆544Updated 6 months ago
- System 2 Reasoning Link Collection☆870Updated 10 months ago
- ☆562Updated last year
- Fast bare-bones BPE for modern tokenizer training☆175Updated 7 months ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆1,042Updated 9 months ago
- ☆492Updated last year
- A comprehensive deep dive into the world of tokens☆227Updated last year
- A repository for research on medium sized language models.☆531Updated 8 months ago
- Building blocks for foundation models.☆599Updated 2 years ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,332Updated 3 weeks ago
- Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.☆238Updated 5 months ago
- A puzzle to learn about prompting☆135Updated 2 years ago
- Minimalistic large language model 3D-parallelism training☆2,544Updated last month
- LLM papers I'm reading, mostly on inference and model compression☆751Updated 2 years ago
- Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax☆693Updated 2 weeks ago
- Minimalistic, extremely fast, and hackable researcher's toolbench for GPT models in 307 lines of code. Reaches <3.8 validation loss on wi…☆355Updated last year
- Website for hosting the Open Foundation Models Cheat Sheet.☆269Updated 9 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,058Updated 5 months ago
- Annotated version of the Mamba paper☆496Updated last year
- Sparsify transformers with SAEs and transcoders☆688Updated 2 weeks ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆944Updated 2 months ago
- ☆232Updated 2 months ago
- UNet diffusion model in pure CUDA☆661Updated last year
- Llama from scratch, or How to implement a paper without crying☆585Updated last year
- Following Karpathy with GPT-2 implementation and training, writing lots of comments cause I have memory of a goldfish☆172Updated last year
- A bibliography and survey of the papers surrounding o1☆1,213Updated last year
- Open-source framework for the research and development of foundation models.☆752Updated this week