EleutherAI / cookbook
Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
☆775Updated last week
Alternatives and similar repositories for cookbook:
Users that are interested in cookbook are comparing it to the libraries listed below
- Minimalistic 4D-parallelism distributed training framework for education purpose☆872Updated this week
- Best practices & guides on how to write distributed pytorch training code☆356Updated last week
- What would you do with 1000 H100s...☆1,009Updated last year
- Minimalistic large language model 3D-parallelism training☆1,630Updated this week
- Building blocks for foundation models.☆454Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆1,238Updated this week
- A bibliography and survey of the papers surrounding o1☆1,172Updated 3 months ago
- Puzzles for learning Triton☆1,452Updated 3 months ago
- ☆418Updated 4 months ago
- A benchmark to evaluate language models on questions I've previously asked them to solve.☆976Updated last month
- System 2 Reasoning Link Collection☆806Updated 3 weeks ago
- ☆468Updated this week
- Recipes to scale inference-time compute of open models☆1,019Updated this week
- Best practices for distilling large language models.☆491Updated last year
- Puzzles for exploring transformers☆333Updated last year
- Textbook on reinforcement learning from human feedback☆466Updated this week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆2,261Updated 2 weeks ago
- ☆392Updated 7 months ago
- UNet diffusion model in pure CUDA☆598Updated 8 months ago
- Sparsify transformers with SAEs and transcoders☆476Updated this week
- Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"☆849Updated last week
- Notes from the Latent Space paper club. Follow along or start your own!☆226Updated 7 months ago
- Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard a…☆1,049Updated last month
- Training Large Language Model to Reason in a Continuous Latent Space☆926Updated last month
- Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch☆503Updated 4 months ago
- LLM Workshop by Sourab Mangrulkar☆366Updated 8 months ago
- NanoGPT (124M) in 3 minutes☆2,336Updated last week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆301Updated 2 months ago