zhangxjohn / LLM-Agent-Benchmark-ListLinks
A banchmark list for evaluation of large language models.
β137Updated last week
Alternatives and similar repositories for LLM-Agent-Benchmark-List
Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below
Sorting:
- augmented LLM with self reflectionβ130Updated last year
- π Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Papβ¦β238Updated 2 weeks ago
- β238Updated last year
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimizationβ165Updated last year
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]β340Updated last year
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examplesβ104Updated last month
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasksβ234Updated 3 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Modelsβ107Updated last month
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.β93Updated 4 months ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safetyβ193Updated last year
- [NeurIPS 2024] Agent Planning with World Knowledge Modelβ148Updated 8 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generationβ119Updated 6 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)β147Updated 9 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAIβ113Updated 2 weeks ago
- β115Updated 7 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]β142Updated 9 months ago
- A curated collection of LLM reasoning and planning resources, including key papers, limitations, benchmarks, and additional learning mateβ¦β287Updated 5 months ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"β188Updated 4 months ago
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'β125Updated 2 months ago
- β201Updated 2 months ago
- [NeurIPS 2024] The official implementation of paper: Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs.β127Updated 5 months ago
- β204Updated 5 months ago
- Code for STaR: Bootstrapping Reasoning With Reasoning (NeurIPS 2022)β209Updated 2 years ago
- InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks (ICML 2024)β145Updated 2 months ago
- Benchmarking LLMs with Challenging Tasks from Real Usersβ237Updated 9 months ago
- Official implementation of the paper Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizersβ167Updated 5 months ago
- Code for paper "Optima: Optimizing Effectiveness and Efficiency for LLM-Based Multi-Agent System"β61Updated 9 months ago
- (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019β¦β148Updated last week
- β96Updated 8 months ago
- Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Zihaβ¦β127Updated last year