Alternatives and similar repositories for recurrent-pretraining

Users that are interested in recurrent-pretraining are comparing it to the libraries listed below

• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,411Updated 4 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,283Updated last week
• DreamLM / Dream
  Dream 7B, a large diffusion language model
  ☆1,115Updated last month
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆362Updated last year
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆584Updated this week
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,120Updated 7 months ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆341Updated last month
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,177Updated 4 months ago
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,056Updated 4 months ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,177Updated 10 months ago
• facebookresearch / MLGym
  MLGym A New Framework and Benchmark for Advancing AI Research Agents
  ☆581Updated 4 months ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆937Updated 3 months ago
• trotsky1997 / MathBlackBox
  ☆1,035Updated last year
• microsoft / rStar
  ☆1,369Updated 3 months ago
• Haiyang-W / TokenFormer
  [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
  ☆579Updated 10 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,387Updated 4 months ago
• ZHZisZZ / dllm
  dLLM: Simple Diffusion Language Modeling
  ☆1,504Updated this week
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆569Updated 2 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆715Updated this week
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆343Updated last year
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆806Updated last year
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆415Updated last month
• PrimeIntellect-ai / prime-rl
  Async RL Training at Scale
  ☆950Updated last week
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆310Updated 3 months ago
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆933Updated last month
• kuleshov-group / bd3lms
  [ICLR 2025 Oral] Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
  ☆920Updated 5 months ago
• facebookresearch / blt
  Code for BLT research paper
  ☆2,018Updated last month
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,216Updated last year
• zhentingqi / rStar
  ☆969Updated 11 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆607Updated 4 months ago