openai / mle-benchLinks
MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
☆1,029Updated last week
Alternatives and similar repositories for mle-bench
Users that are interested in mle-bench are comparing it to the libraries listed below
Sorting:
- AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.☆1,048Updated last month
- [NeurIPS'25] Official codebase for "SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution"☆607Updated 7 months ago
- ☆1,035Updated 10 months ago
- MLGym A New Framework and Benchmark for Advancing AI Research Agents☆560Updated 2 months ago
- Recipes to scale inference-time compute of open models☆1,111Updated 5 months ago
- Code and Data for Tau-Bench☆891Updated last month
- An agent benchmark with tasks in a simulated software company.☆570Updated 2 weeks ago
- Code for Paper: Training Software Engineering Agents and Verifiers with SWE-Gym [ICML 2025]☆553Updated 2 months ago
- Code for Quiet-STaR☆739Updated last year
- [ICLR 2025] Automated Design of Agentic Systems☆1,438Updated 8 months ago
- ☆1,309Updated last month
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,060Updated last week
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆427Updated last week
- Automatic evals for LLMs☆547Updated 3 months ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,194Updated 2 weeks ago
- Post-training with Tinker☆1,096Updated this week
- OpenAI Frontier Evals☆918Updated last month
- xLAM: A Family of Large Action Models to Empower AI Agent Systems☆564Updated 2 months ago
- A project to improve skills of large language models☆587Updated this week
- ☆963Updated 9 months ago
- Large Reasoning Models☆805Updated 10 months ago
- [COLM 2025] LIMO: Less is More for Reasoning☆1,037Updated 2 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆1,297Updated 2 months ago
- 🔍 Search-o1: Agentic Search-Enhanced Large Reasoning Models [EMNLP 2025]☆1,064Updated 2 months ago
- A bibliography and survey of the papers surrounding o1☆1,209Updated 11 months ago
- GPQA: A Graduate-Level Google-Proof Q&A Benchmark☆417Updated last year
- An Open Large Reasoning Model for Real-World Solutions☆1,522Updated 4 months ago
- Autonomous Agents (LLMs) research papers. Updated Daily.☆1,032Updated last week
- [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"☆796Updated last year
- [NeurIPS 2024 Spotlight] Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models☆666Updated 3 months ago