zhangxjohn / LLM-Agent-Benchmark-List
A banchmark list for evaluation of large language models.
☆68Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for LLM-Agent-Benchmark-List
- Benchmarking LLMs with Challenging Tasks from Real Users☆194Updated last week
- ☆116Updated 5 months ago
- ☆111Updated last month
- ☆190Updated 2 months ago
- augmented LLM with self reflection☆100Updated 11 months ago
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆109Updated 5 months ago
- Trial and Error: Exploration-Based Trajectory Optimization of LLM Agents (ACL 2024 Main Conference)☆96Updated 2 weeks ago
- [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning☆177Updated last month
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆83Updated 7 months ago
- ☆85Updated 6 months ago
- [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View☆98Updated 5 months ago
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆114Updated 7 months ago
- Critique-out-Loud Reward Models☆36Updated 3 weeks ago
- Official code for "MAmmoTH2: Scaling Instructions from the Web" [NeurIPS 2024]☆124Updated 2 weeks ago
- Code for the paper 🌳 Tree Search for Language Model Agents☆138Updated 3 months ago
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆73Updated 3 months ago
- Can Language Models Solve Olympiad Programming?☆100Updated 3 months ago
- PASTA: Post-hoc Attention Steering for LLMs☆107Updated 2 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆143Updated 8 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆96Updated 6 months ago
- Awesome LLM Self-Consistency: a curated list of Self-consistency in Large Language Models☆76Updated 3 months ago
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆95Updated 2 months ago
- An Analytical Evaluation Board of Multi-turn LLM Agents☆245Updated 5 months ago
- Code for Paper: Autonomous Evaluation and Refinement of Digital Agents [COLM 2024]☆94Updated 3 weeks ago
- Reformatted Alignment☆112Updated last month
- 🌍 Repository for "AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agent", ACL'24 Best Resource Pap…☆106Updated 3 weeks ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆68Updated 3 weeks ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆48Updated 8 months ago
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆83Updated 4 months ago
- Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆38Updated last month