thunlp / ChatEval
Codes for our paper "ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate"
☆234Updated last month
Related projects ⓘ
Alternatives and complementary repositories for ChatEval
- FireAct: Toward Language Agent Fine-tuning☆255Updated last year
- [ACL 2024] AUTOACT: Automatic Agent Learning from Scratch for QA via Self-Planning☆178Updated last month
- An Analytical Evaluation Board of Multi-turn LLM Agents☆250Updated 6 months ago
- Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".☆179Updated 5 months ago
- Repo for paper "Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration"☆315Updated 6 months ago
- This is the official repo for "PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization". PromptAgen…☆204Updated 3 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆240Updated last year
- [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View☆102Updated 6 months ago
- MAD: The first work to explore Multi-Agent Debate with Large Language Models :D☆275Updated last year
- KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents☆172Updated last month
- papers related to LLM-agent that published on top conferences☆305Updated 9 months ago
- Official implementation of paper "Cumulative Reasoning With Large Language Models" (https://arxiv.org/abs/2308.04371)☆287Updated 2 months ago
- This repository contains the paper list for the paper: Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reaso…☆342Updated 11 months ago
- Paper collection on building and evaluating language model agents via executable language grounding☆339Updated 6 months ago
- Generative Judge for Evaluating Alignment☆217Updated 10 months ago
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆625Updated last month
- ☆171Updated 6 months ago
- ☆116Updated 5 months ago
- Data and Code for Program of Thoughts (TMLR 2023)☆243Updated 6 months ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆235Updated 7 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆114Updated 2 months ago
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆111Updated 6 months ago
- [ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use☆70Updated 8 months ago
- Repository for Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions, ACL23☆173Updated 5 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆144Updated 8 months ago
- [ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"☆247Updated 3 weeks ago
- A large-scale, fine-grained, diverse preference dataset (and models).☆315Updated 10 months ago
- ☆217Updated 3 months ago
- Evaluating LLMs' multi-round chatting capability via assessing conversations generated by two LLM instances.☆139Updated last year
- ☆190Updated 3 months ago