Alternatives and similar repositories for recurrent-pretraining

Users that are interested in recurrent-pretraining are comparing it to the libraries listed below

• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,162Updated 5 months ago
• HKUNLP / Dream
  Dream 7B, a large diffusion language model
  ☆774Updated last week
• open-thought / reasoning-gym
  procedural reasoning datasets
  ☆872Updated this week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,097Updated last month
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆991Updated last month
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆383Updated 2 weeks ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆339Updated 6 months ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆315Updated 7 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,081Updated 2 months ago
• GAIR-NLP / LIMO
  LIMO: Less is More for Reasoning
  ☆963Updated 2 months ago
• facebookresearch / blt
  Code for BLT research paper
  ☆1,686Updated last month
• huggingface / Math-Verify
  ☆782Updated last month
• kuleshov-group / bd3lms
  Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
  ☆703Updated 2 months ago
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆385Updated last week
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆476Updated last month
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆260Updated 3 weeks ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,106Updated 4 months ago
• trotsky1997 / MathBlackBox
  ☆1,025Updated 6 months ago
• zhentingqi / rStar
  ☆939Updated 5 months ago
• microsoft / rStar
  ☆570Updated 2 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,201Updated 7 months ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆788Updated 3 months ago
• willccbb / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆1,328Updated this week
• PRIME-RL / TTRL
  TTRL: Test-Time Reinforcement Learning
  ☆650Updated 3 weeks ago
• sunblaze-ucb / Intuitor
  Code for the paper: "Learning to Reason without External Rewards"
  ☆306Updated last week
• facebookresearch / swe-rl
  Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆551Updated 3 months ago
• PRIME-RL / PRIME
  Scalable RL solution for advanced reasoning of language models
  ☆1,622Updated 3 months ago
• NVIDIA / NeMo-Skills
  A project to improve skills of large language models
  ☆429Updated this week
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆489Updated last month
• KellerJordan / Muon
  Muon: An optimizer for hidden layers in neural networks
  ☆897Updated 2 weeks ago