McGill-NLP / nano-aha-momentLinks
Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
☆497Updated last week
Alternatives and similar repositories for nano-aha-moment
Users that are interested in nano-aha-moment are comparing it to the libraries listed below
Sorting:
- Understanding R1-Zero-Like Training: A Critical Perspective☆1,023Updated 2 weeks ago
- ☆198Updated 5 months ago
- procedural reasoning datasets☆938Updated last week
- prime-rl is a codebase for decentralized async RL training at scale☆368Updated this week
- Exploring Applications of GRPO☆240Updated this week
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆341Updated 7 months ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆404Updated this week
- Build your own visual reasoning model☆395Updated last week
- A bibliography and survey of the papers surrounding o1☆1,205Updated 8 months ago
- Recipes to scale inference-time compute of open models☆1,101Updated last month
- Tina: Tiny Reasoning Models via LoRA☆266Updated last month
- An extension of the nanoGPT repository for training small MOE models.☆160Updated 4 months ago
- SkyRL: A Modular Full-stack RL Library for LLMs☆574Updated last week
- PyTorch building blocks for the OLMo ecosystem☆258Updated last week
- Minimal hackable GRPO implementation☆252Updated 5 months ago
- A project to improve skills of large language models☆456Updated this week
- Dream 7B, a large diffusion language model☆816Updated 3 weeks ago
- Textbook on reinforcement learning from human feedback☆1,083Updated last week
- Pretraining code for a large-scale depth-recurrent language model☆793Updated last month
- Training Large Language Model to Reason in a Continuous Latent Space☆1,185Updated 5 months ago
- ☆585Updated 3 months ago
- System 2 Reasoning Link Collection☆843Updated 4 months ago
- Scalable toolkit for efficient model reinforcement☆499Updated this week
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆720Updated 3 months ago
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆318Updated 7 months ago
- ☆316Updated 6 months ago
- Muon is Scalable for LLM Training☆1,093Updated 3 months ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆529Updated 3 weeks ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,588Updated last week
- ☆259Updated last week