McGill-NLP / nano-aha-momentLinks
Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
☆476Updated last month
Alternatives and similar repositories for nano-aha-moment
Users that are interested in nano-aha-moment are comparing it to the libraries listed below
Sorting:
- Understanding R1-Zero-Like Training: A Critical Perspective☆991Updated last month
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆383Updated 2 weeks ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆339Updated 6 months ago
- Exploring Applications of GRPO☆230Updated last month
- PyTorch building blocks for the OLMo ecosystem☆238Updated this week
- Build your own visual reasoning model☆385Updated last week
- Tina: Tiny Reasoning Models via LoRA☆260Updated 3 weeks ago
- A bibliography and survey of the papers surrounding o1☆1,201Updated 7 months ago
- ☆193Updated 4 months ago
- procedural reasoning datasets☆872Updated this week
- A project to improve skills of large language models☆429Updated this week
- Recipes to scale inference-time compute of open models☆1,097Updated last month
- SkyRL-v0: Train Real-World Long-Horizon Agents via Reinforcement Learning☆422Updated this week
- prime-rl is a codebase for decentralized async RL training at scale☆341Updated this week
- Scalable toolkit for efficient model reinforcement☆448Updated this week
- Training Large Language Model to Reason in a Continuous Latent Space☆1,162Updated 5 months ago
- Large Reasoning Models☆804Updated 6 months ago
- Muon is Scalable for LLM Training☆1,081Updated 2 months ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,554Updated 3 weeks ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆519Updated this week
- An extension of the nanoGPT repository for training small MOE models.☆152Updated 3 months ago
- official repository for “Reinforcement Learning for Reasoning in Large Language Models with One Training Example”☆304Updated last week
- ☆782Updated last month
- Dream 7B, a large diffusion language model☆774Updated last week
- Pretraining code for a large-scale depth-recurrent language model☆783Updated 2 weeks ago
- Minimal hackable GRPO implementation☆247Updated 4 months ago
- TTRL: Test-Time Reinforcement Learning☆650Updated 2 weeks ago
- Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training☆281Updated last month
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆702Updated 3 months ago
- Automatic evals for LLMs☆437Updated 2 weeks ago