zhangxjohn / LLM-Agent-Benchmark-ListLinks
A banchmark list for evaluation of large language models.
☆149Updated 2 months ago
Alternatives and similar repositories for LLM-Agent-Benchmark-List
Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below
Sorting:
- ☆239Updated last year
- augmented LLM with self reflection☆134Updated last year
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆360Updated last year
- 🌍 AppWorld: A Controllable World of Apps and People for Benchmarking Function Calling and Interactive Coding Agent, ACL'24 Best Resource…☆307Updated this week
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆110Updated 3 months ago
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆249Updated 6 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆133Updated 8 months ago
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆155Updated 11 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆147Updated 11 months ago
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆178Updated last year
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆128Updated 5 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆152Updated last year
- ☆117Updated 9 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆107Updated 2 weeks ago
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Ziha…☆133Updated last year
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆202Updated last year
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆111Updated 3 weeks ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆197Updated 6 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆217Updated last year
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆111Updated 3 months ago
- A curated collection of LLM reasoning and planning resources, including key papers, limitations, benchmarks, and additional learning mate…☆304Updated 8 months ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆185Updated 4 months ago
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆100Updated last year
- InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)☆157Updated 5 months ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆244Updated last year
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆144Updated last year
- MPO: Boosting LLM Agents with Meta Plan Optimization (EMNLP 2025 Findings)☆73Updated 2 months ago
- ☆215Updated 7 months ago
- ☆313Updated last year
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆164Updated last year