openai / mle-bench
MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering
☆517Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for mle-bench
- Code for Quiet-STaR☆651Updated 3 months ago
- ☆935Updated 2 weeks ago
- A reading list on LLM based Synthetic Data Generation 🔥☆791Updated 2 weeks ago
- AIDE: the state-of-the-art machine learning engineer agent, generating machine learning solution code from natural language descriptions.☆594Updated 2 weeks ago
- AWM: Agent Workflow Memory☆205Updated last month
- Automated Design of Agentic Systems☆1,038Updated this week
- [ICML 2024] Official repository for "Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models"☆682Updated 3 months ago
- ☆316Updated last month
- A compilation of the best multi-agent papers☆258Updated 2 weeks ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆339Updated 2 months ago
- Code for Husky, an open-source language agent that solves complex, multi-step reasoning tasks. Husky v1 addresses numerical, tabular and …☆328Updated 5 months ago
- Evaluate your LLM's response with Prometheus and GPT4 💯☆797Updated 2 months ago
- Automatically evaluate your LLMs in Google Colab☆559Updated 6 months ago
- Code and Data for Tau-Bench☆201Updated 3 weeks ago
- ☆451Updated 3 weeks ago
- System 2 Reasoning Link Collection☆693Updated 3 weeks ago
- Agentless🐱: an agentless approach to automatically solve software development problems☆723Updated last week
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆811Updated this week
- Autonomous Agents (LLMs) research papers. Updated Daily.☆515Updated last week
- Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"☆448Updated 8 months ago
- Official repository for "Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing". Your efficient and high-quality s…☆491Updated 2 weeks ago
- Official repository for ORPO☆421Updated 5 months ago
- [NeurIPS 2024 Spotlight] Buffer of Thoughts: Thought-Augmented Reasoning with Large Language Models☆535Updated 3 weeks ago
- Large Reasoning Models☆580Updated this week
- Awesome-LLM-Prompt-Optimization: a curated list of advanced prompt optimization and tuning methods in Large Language Models☆236Updated 7 months ago
- ☆526Updated last month
- ☆247Updated 5 months ago
- A bibliography and survey of the papers surrounding o1☆754Updated this week
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models☆835Updated 7 months ago