openai / mle-bench
MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
☆589Updated this week
Alternatives and similar repositories for mle-bench:
Users that are interested in mle-bench are comparing it to the libraries listed below
- AIDE: the state-of-the-art machine learning engineer agent, generating machine learning solution code from natural language descriptions.☆696Updated this week
- Recipes to scale inference-time compute of open models☆932Updated this week
- Code for Quiet-STaR☆698Updated 4 months ago
- AWM: Agent Workflow Memory☆231Updated last month
- [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"☆724Updated 5 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆346Updated 4 months ago
- ☆996Updated last month
- Search-o1: Agentic Search-Enhanced Large Reasoning Models☆335Updated this week
- 🤠 Agent-as-a-Judge and DevAI dataset☆308Updated 3 weeks ago
- Automated Design of Agentic Systems☆1,135Updated last week
- ☆342Updated this week
- Evaluate your LLM's response with Prometheus and GPT4 💯☆841Updated last week
- Large Reasoning Models☆787Updated last month
- Official Repo for ICML 2024 paper "Executable Code Actions Elicit Better LLM Agents" by Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhan…☆548Updated 7 months ago
- A reading list on LLM based Synthetic Data Generation 🔥☆969Updated 2 months ago
- AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and re…☆189Updated this week
- System 2 Reasoning Link Collection☆722Updated this week
- Code and Data for Tau-Bench☆253Updated last week
- A compilation of the best multi-agent papers☆341Updated last week
- Autonomous Agents (LLMs) research papers. Updated Daily.☆606Updated this week
- Agentless🐱: an agentless approach to automatically solve software development problems☆1,281Updated 3 weeks ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆970Updated this week
- TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle☆182Updated this week
- ☆812Updated last week
- A bibliography and survey of the papers surrounding o1☆1,042Updated 2 months ago
- ☆484Updated last month
- OLMoE: Open Mixture-of-Experts Language Models☆531Updated last month
- An Open Source Toolkit For LLM Distillation☆425Updated last week
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆565Updated last week
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆331Updated 7 months ago