zhangxjohn / LLM-Agent-Benchmark-ListLinks
A banchmark list for evaluation of large language models.
☆143Updated 3 weeks ago
Alternatives and similar repositories for LLM-Agent-Benchmark-List
Users that are interested in LLM-Agent-Benchmark-List are comparing it to the libraries listed below
Sorting:
- augmented LLM with self reflection☆133Updated last year
- ☆240Updated last year
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆250Updated last month
- Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike stat…☆263Updated 2 weeks ago
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆106Updated 2 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆354Updated last year
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆169Updated last year
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆151Updated 11 months ago
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆112Updated last week
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆245Updated 5 months ago
- [COLM 2025] Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆166Updated 2 months ago
- [ICLR 2025] Benchmarking Agentic Workflow Generation☆129Updated 7 months ago
- ☆116Updated 8 months ago
- A curated collection of LLM reasoning and planning resources, including key papers, limitations, benchmarks, and additional learning mate…☆297Updated 7 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆145Updated 10 months ago
- Framework and toolkits for building and evaluating collaborative agents that can work together with humans.☆99Updated last week
- ☆96Updated 9 months ago
- Critique-out-Loud Reward Models☆70Updated 11 months ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆217Updated last year
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆198Updated last year
- [NeurIPS 2024] Agent Planning with World Knowledge Model☆149Updated 9 months ago
- Research Code for "ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL"☆193Updated 5 months ago
- Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering☆61Updated 10 months ago
- Official repository for ACL 2025 paper "ProcessBench: Identifying Process Errors in Mathematical Reasoning"☆171Updated 4 months ago
- (ACL 2025 Main) Code for MultiAgentBench : Evaluating the Collaboration and Competition of LLM agents https://www.arxiv.org/pdf/2503.019…☆167Updated last week
- Curation of resources for LLM mathematical reasoning, most of which are screened by @tongyx361 to ensure high quality and accompanied wit…☆142Updated last year
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆109Updated 2 months ago
- This repository contains a LLM benchmark for the social deduction game `Resistance Avalon'☆126Updated 4 months ago
- A Framework for LLM-based Multi-Agent Reinforced Training and Inference☆276Updated this week
- RL Scaling and Test-Time Scaling (ICML'25)☆111Updated 8 months ago