Alternatives and similar repositories for awesome-o1

Users that are interested in awesome-o1 are comparing it to the libraries listed below

• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,123Updated 7 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,304Updated last month
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆899Updated 3 months ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,449Updated 5 months ago
• sail-sg / oat
  🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.
  ☆614Updated last week
• huggingface / Math-Verify
  ☆1,067Updated last week
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,456Updated this week
• allenai / reward-bench
  RewardBench: the first evaluation tool for reward models.
  ☆680Updated 7 months ago
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆867Updated 10 months ago
• trotsky1997 / MathBlackBox
  ☆1,032Updated last year
• McGill-NLP / nano-aha-moment
  Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"
  ☆576Updated 3 months ago
• sail-sg / understand-r1-zero
  Understanding R1-Zero-Like Training: A Critical Perspective
  ☆1,186Updated 4 months ago
• NVIDIA / NeMo-Aligner
  Scalable toolkit for efficient model alignment
  ☆847Updated 3 months ago
• princeton-nlp / SimPO
  [NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward
  ☆938Updated 11 months ago
• openai / sparse_autoencoder
  ☆561Updated last year
• andyzoujm / representation-engineering
  Representation Engineering: A Top-Down Approach to AI Transparency
  ☆938Updated last year
• jzhang38 / EasyContext
  Memory optimization and training recipes to extrapolate language models' context length to 1 million tokens, with minimal hardware.
  ☆751Updated last year
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆574Updated 3 weeks ago
• GAIR-NLP / O1-Journey
  O1 Replication Journey
  ☆2,003Updated last year
• maitrix-org / llm-reasoners
  A library for advanced large language model reasoning
  ☆2,320Updated 7 months ago
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆2,411Updated last month
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆742Updated last year
• marin-community / marin
  Open-source framework for the research and development of foundation models.
  ☆711Updated this week
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆805Updated last year
• zhentingqi / rStar
  ☆968Updated 11 months ago
• seal-rg / recurrent-pretraining
  Pretraining and inference code for a large-scale depth-recurrent language model
  ☆859Updated 2 weeks ago
• THUDM / ReST-MCTS
  ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search (NeurIPS 2024)
  ☆688Updated 11 months ago
• allenai / OLMoE
  OLMoE: Open Mixture-of-Experts Language Models
  ☆950Updated 3 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆756Updated this week
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆851Updated 3 months ago