[NeurIPS 2025 D&B Track] MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Research
☆38Sep 8, 2026Updated last month
Alternatives and similar repositories for mlrbench
Users that are interested in mlrbench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- FabScore: Fine-Grained Evaluation of Fabrications in Automated AI Research☆23Sep 8, 2026Updated last month
- This repository implements AutoThink in our paper: Learning When to Think: Shaping Adaptive Reasoning in R1-Style Models via Multi-Stag…☆11May 20, 2025Updated last year
- Evaluating the ability of LLM Agents to conduct research: the core focus is — what exactly are the gaps between AI Agents and real human …☆15Jun 11, 2026Updated 4 months ago
- Improving Math reasoning through Direct Preference Optimization with Verifiable Pairs☆21Mar 20, 2025Updated last year
- ☆19Aug 27, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆32Sep 21, 2026Updated last month
- Code for the EMNLP 2022 Findings short paper "SAT: Improving Semi-Supervised Text Classification with Simple Instance-Adaptive Self-Train…☆12Feb 25, 2023Updated 3 years ago
- Benchmark and execution environment for evaluating LLM agents on end-to-end AI Research. [ICLR 2026]☆43May 31, 2026Updated 5 months ago
- [AAMAS'25] Code for "Online Preference-based Reinforcement Learning with Self-augmented Feedback from Large Language Model"☆12May 27, 2025Updated last year
- ☆14Oct 25, 2026Updated last week
- Our EMNLP 2022 paper on MCQA☆23Jan 15, 2023Updated 3 years ago
- ☆17Oct 22, 2024Updated 2 years ago
- Pytorch implementation of EvenNet.☆21Oct 25, 2022Updated 4 years ago
- [NeurIPS'25] The official code of "PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning"☆30Mar 30, 2026Updated 7 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AutoThink is a reinforcement learning framework designed to equip R1-style language models with adaptive reasoning capabilities. Instead …☆54Oct 14, 2025Updated last year
- ☆25Aug 2, 2025Updated last year
- Official code of paper "Beyond 'Aha!': Toward Systematic Meta-Abilities Alignment in Large Reasoning Models"☆87May 27, 2025Updated last year
- [ACL Findings 2026] "Diagnosing and Improving Faithfulness in Chain-of-Thought for Multimodal Large Language Models"☆15Apr 8, 2026Updated 6 months ago
- ☆12Sep 21, 2026Updated last month
- Tensorflow 2.0 Implement of AnimeGAN☆12Apr 26, 2020Updated 6 years ago
- AutoLibra: Metric Induction for Agents from Open-Ended Human Feedback☆19Apr 23, 2026Updated 6 months ago
- Coco is a proactive co-assistant that connects user workspace with a broader ecosystem of AI agents.☆43Updated this week
- TIGeR: Tool-Integrated Geometric Reasoning in Vision-Language Models for Robotics☆23Nov 18, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [AAAI 2025] Assessing the Creativity of LLMs in Proposing Novel Solutions to Mathematical Problems☆13May 5, 2025Updated last year
- PERK: Long-Context Reasoning as Test-Time Learning☆15Sep 25, 2026Updated last month
- ☆13Aug 13, 2024Updated 2 years ago
- Official repository of paper "Context-DPO: Aligning Language Models for Context-Faithfulness"☆24Feb 17, 2025Updated last year
- (CVPR 2024) "Unsegment Anything by Simulating Deformation"☆29May 27, 2024Updated 2 years ago
- [NLPCC 2022] Kformer: Knowledge Injection in Transformer Feed-Forward Layers☆39Oct 20, 2022Updated 4 years ago
- 🗺️ Intern Atlas: Methodology-evolution graph builder from academic papers☆45May 28, 2026Updated 5 months ago
- Official Code: TheWebConf 2022 Compact Graph Structure Learning via Mutual Information Compression☆25Mar 17, 2024Updated 2 years ago
- Tensorflow implementation of Invariant Rationalization☆50Feb 16, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆108Oct 30, 2025Updated last year
- Autonomous vehicle learn how to navigate efficiently at crossroad☆16Jan 31, 2018Updated 8 years ago
- Artefacts from the first complete run of the Lossfunk AI Scientist pipeline for paper accepted at Agents4Science 2025.☆25Nov 10, 2025Updated 11 months ago
- A benchmark for evaluating LLMs on open-ended CS problems. Exploring the Next Frontier of Computer Science.☆339Oct 22, 2026Updated last week
- Source code for WWW 2021 paper "Graph Structure Estimation Neural Networks"☆60Jul 15, 2021Updated 5 years ago
- Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'☆27May 16, 2025Updated last year
- ☆10Apr 6, 2017Updated 9 years ago