Alternatives and similar repositories for recurrent-pretraining

Users that are interested in recurrent-pretraining are comparing it to the libraries listed below

• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,327Updated 3 months ago
• DreamLM / Dream
  Dream 7B, a large diffusion language model
  ☆1,054Updated last month
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,214Updated last month
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,117Updated 5 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆355Updated 11 months ago
• SakanaAI / self-adaptive-llms
  A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!
  ☆1,162Updated 9 months ago
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,045Updated 3 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆564Updated 2 weeks ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆336Updated this week
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,148Updated 2 months ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆901Updated last month
• facebookresearch / MLGym
  MLGym A New Framework and Benchmark for Advancing AI Research Agents
  ☆568Updated 3 months ago
• groundlight / r1_vlm
  Build your own visual reasoning model
  ☆414Updated last month
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆556Updated last month
• microsoft / Samba
  [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling
  ☆926Updated 2 weeks ago
• trotsky1997 / MathBlackBox
  ☆1,035Updated 10 months ago
• Haiyang-W / TokenFormer
  [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
  ☆576Updated 9 months ago
• microsoft / rStar
  ☆1,335Updated 2 months ago
• MoonshotAI / Moonlight
  Muon is Scalable for LLM Training
  ☆1,354Updated 3 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,209Updated last year
• shangshang-wang / Tina
  Tina: Tiny Reasoning Models via LoRA
  ☆304Updated last month
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆608Updated last week
• ZHZisZZ / dllm
  dLLM: Simple Diffusion Language Modeling
  ☆529Updated this week
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆741Updated last year
• thinking-machines-lab / batch_invariant_ops
  ☆894Updated last week
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆573Updated 3 months ago
• PrimeIntellect-ai / prime-rl
  Async RL Training at Scale
  ☆770Updated this week
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,202Updated this week
• kuleshov-group / bd3lms
  [ICLR 2025 Oral] Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
  ☆884Updated 4 months ago
• goombalab / hnet
  H-Net: Hierarchical Network with Dynamic Chunking
  ☆778Updated last month