McGill-NLP / nano-aha-moment
Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
☆419Updated 2 weeks ago
Alternatives and similar repositories for nano-aha-moment:
Users that are interested in nano-aha-moment are comparing it to the libraries listed below
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆320Updated 4 months ago
- Understanding R1-Zero-Like Training: A Critical Perspective☆882Updated last week
- 🌾 OAT: A research-friendly framework for LLM online alignment, including preference learning, reinforcement learning, etc.☆331Updated last week
- Exploring Applications of GRPO☆185Updated last week
- Recipes to scale inference-time compute of open models☆1,058Updated 2 months ago
- An extension of the nanoGPT repository for training small MOE models.☆131Updated last month
- PyTorch building blocks for the OLMo ecosystem☆197Updated this week
- Build your own visual reasoning model☆341Updated this week
- ☆519Updated last week
- A bibliography and survey of the papers surrounding o1☆1,187Updated 5 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆1,076Updated 3 months ago
- ☆169Updated 2 months ago
- System 2 Reasoning Link Collection☆826Updated last month
- Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"☆304Updated 5 months ago
- LIMO: Less is More for Reasoning☆920Updated 3 weeks ago
- Large Reasoning Models☆802Updated 4 months ago
- TTRL: Test-Time Reinforcement Learning☆166Updated this week
- A brief and partial summary of RLHF algorithms.☆127Updated last month
- Verifiers for LLM Reinforcement Learning☆827Updated 3 weeks ago
- Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆509Updated last month
- procedural reasoning datasets☆571Updated this week
- ☆283Updated last month
- A project to improve skills of large language models☆295Updated this week
- ☆647Updated 3 weeks ago
- Minimalistic 4D-parallelism distributed training framework for education purpose☆991Updated last month
- ☆144Updated last month
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆636Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆171Updated 3 months ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym☆443Updated 3 weeks ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆161Updated this week