Alternatives and similar repositories for mle-bench

Users that are interested in mle-bench are comparing it to the libraries listed below

• WecoAI / aideml
  AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.
  ☆1,106Updated 2 months ago
• facebookresearch / MLGym
  MLGym A New Framework and Benchmark for Advancing AI Research Agents
  ☆583Updated 4 months ago
• facebookresearch / swe-rl
  [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"
  ☆650Updated 9 months ago
• microsoft / rStar
  ☆1,377Updated 3 months ago
• sierra-research / tau-bench
  Code and Data for Tau-Bench
  ☆1,037Updated 4 months ago
• trotsky1997 / MathBlackBox
  ☆1,035Updated last year
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,123Updated 7 months ago
• SWE-Gym / SWE-Gym
  Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]
  ☆609Updated 5 months ago
• NovaSky-AI / SkyRL
  SkyRL: A Modular Full-stack RL Library for LLMs
  ☆1,415Updated this week
• GAIR-NLP / LIMO
  [COLM 2025] LIMO: Less is More for Reasoning
  ☆1,059Updated 5 months ago
• openai / frontier-evals
  OpenAI Frontier Evals
  ☆971Updated last month
• ShengranHu / ADAS
  [ICLR 2025] Automated Design of Agentic Systems
  ☆1,480Updated 11 months ago
• zhentingqi / rStar
  ☆969Updated 11 months ago
• facebookresearch / coconut
  Training Large Language Model to Reason in a Continuous Latent Space
  ☆1,430Updated 4 months ago
• open-thought / reasoning-gym
  [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards
  ☆1,296Updated 3 weeks ago
• TheAgentCompany / TheAgentCompany
  An agent benchmark with tasks in a simulated software company.
  ☆617Updated last month
• SimpleBerry / LLaMA-O1
  Large Reasoning Models
  ☆806Updated last year
• AIDC-AI / Marco-o1
  An Open Large Reasoning Model for Real-World Solutions
  ☆1,536Updated 7 months ago
• SalesforceAIResearch / xLAM
  xLAM: A Family of Large Action Models to Empower AI Agent Systems
  ☆596Updated 4 months ago
• LiveCodeBench / LiveCodeBench
  Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
  ☆753Updated 5 months ago
• ezelikman / quiet-star
  Code for Quiet-STaR
  ☆742Updated last year
• Agent-RL / ReCall
  ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning & ReCall: Learning to Reason with Tool Call for LLMs via Rei…
  ☆1,277Updated 7 months ago
• mll-lab-nu / RAGEN
  RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.
  ☆2,467Updated this week
• metauto-ai / agent-as-a-judge
  👩‍⚖️ Agent-as-a-Judge: The Magic for Open-Endedness
  ☆696Updated 7 months ago
• NVIDIA-NeMo / Skills
  A project to improve skills of large language models
  ☆734Updated this week
• mlfoundations / evalchemy
  Automatic evals for LLMs
  ☆570Updated 2 weeks ago
• sierra-research / tau2-bench
  τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
  ☆583Updated 2 weeks ago
• WooooDyy / AgentGym
  Code and implementations for the ACL 2025 paper "AgentGym: Evolving Large Language Model-based Agents across Diverse Environments" by Zhi…
  ☆675Updated 3 months ago
• maitrix-org / llm-reasoners
  A library for advanced large language model reasoning
  ☆2,319Updated 6 months ago
• Open-Source-O1 / Open-O1
  ☆1,344Updated last year