A banchmark list for evaluation of large language models.
☆162Feb 26, 2026Updated last month
Alternatives and similar repositories for LLM-Agent-Benchmark-List
Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simple repository for training small reasoning models☆49Feb 17, 2026Updated last month
- Official implementation of Panacea: A foundation model for clinical trial design, recruitment, search, and summarization.☆18Dec 24, 2024Updated last year
- [ACL'25 (Findings)] Explorer: Scaling Exploration-driven Web Trajectory Synthesis for Multimodal Web Agents☆28Feb 17, 2026Updated last month
- Autonomous Agents (LLMs) research papers. Updated Daily.☆1,208Updated this week
- [EMNLP 2022] TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data☆17May 17, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)☆3,316Feb 8, 2026Updated 2 months ago
- ☆15Dec 4, 2023Updated 2 years ago
- Source code of MOLLEO☆55Jul 8, 2025Updated 9 months ago
- Serializing molecule 3D structures☆14Nov 27, 2024Updated last year
- Automatic, unsupervised collection of web agent training data via exploration.☆24Oct 8, 2025Updated 6 months ago
- ☆19Oct 27, 2025Updated 5 months ago
- Must-read Papers on LLM Agents.☆2,961Apr 7, 2026Updated last week
- Shopping MMLU: A Multi-Task Online Shopping Benchmark for LLMs.☆46Nov 4, 2024Updated last year
- ☆41Apr 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Active Example Selection for In-Context Learning (EMNLP'22)☆49Jul 22, 2024Updated last year
- Medea: An omics AI agent for therapeutic discovery☆72Mar 26, 2026Updated 2 weeks ago
- A unified benchmark for math reasoning☆90Jan 25, 2023Updated 3 years ago
- SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis☆118Jun 3, 2025Updated 10 months ago
- ☆14Mar 2, 2023Updated 3 years ago
- Large Language Models in Molecular Embeddings☆12May 1, 2024Updated last year
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆403Feb 17, 2026Updated last month
- ☆42Feb 12, 2026Updated 2 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆406May 20, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆78Jun 28, 2025Updated 9 months ago
- ☆20Feb 26, 2021Updated 5 years ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆161Oct 30, 2024Updated last year
- [EMNLP 2023] ReLM: Leveraging Language Models for Enhanced Chemical Reaction Prediction.☆22Jan 28, 2024Updated 2 years ago
- ☆32Mar 12, 2025Updated last year
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆367Sep 6, 2024Updated last year
- Structured Chemistry Reasoning with Large Language Models☆41May 4, 2024Updated last year
- A benchmark that challenges language models to code solutions for scientific problems☆186Apr 6, 2026Updated last week
- InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)☆187May 29, 2025Updated 10 months ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Codes for ACL 2023 Paper "Fact-Checking Complex Claims with Program-Guided Reasoning"☆31Jun 2, 2023Updated 2 years ago
- ☆14May 9, 2024Updated last year
- ☆23Oct 11, 2024Updated last year
- Official repo for paper DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning.☆394Feb 22, 2025Updated last year
- ReSearch: Learning to Reason with Search for LLMs via Reinforcement Learning & ReCall: Learning to Reason with Tool Call for LLMs via Rei…☆1,362May 16, 2025Updated 10 months ago
- ☆40Apr 6, 2026Updated last week
- A Gym for Agentic LLMs☆476Jan 21, 2026Updated 2 months ago