thunlp / ChatEval
Codes for our paper "ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate"
☆265Updated 5 months ago
Alternatives and similar repositories for ChatEval:
Users that are interested in ChatEval are comparing it to the libraries listed below
- papers related to LLM-agent that published on top conferences☆312Updated last year
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆297Updated 10 months ago
- MAD: The first work to explore Multi-Agent Debate with Large Language Models :D☆350Updated 2 months ago
- This is the official repo for "PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt Optimization". PromptAgen…☆256Updated 7 months ago
- [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning☆218Updated 2 months ago
- Generative Judge for Evaluating Alignment☆232Updated last year
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆255Updated last year
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆673Updated 5 months ago
- Data and Code for Program of Thoughts (TMLR 2023)☆266Updated 10 months ago
- ☆207Updated 11 months ago
- FireAct: Toward Language Agent Fine-tuning☆274Updated last year
- Repo for paper "Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration"☆325Updated 10 months ago
- ICML 2024: Improving Factuality and Reasoning in Language Models through Multiagent Debate☆417Updated last year
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆135Updated 10 months ago
- Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"☆236Updated 10 months ago
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆261Updated 11 months ago
- [NAACL 2025] KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents☆215Updated 2 months ago
- Official implementation of paper "Cumulative Reasoning With Large Language Models" (https://arxiv.org/abs/2308.04371)☆291Updated 6 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆139Updated last week
- Paper collection on building and evaluating language model agents via executable language grounding☆348Updated 11 months ago
- ☆277Updated last year
- Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".☆230Updated 10 months ago
- This repository contains the paper list for the paper: Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reaso…☆352Updated last year
- ☆217Updated 7 months ago
- This is the repository for the Tool Learning survey.☆337Updated 3 weeks ago
- [NeurIPS 2023] Codebase for the paper: "Guiding Large Language Models with Directional Stimulus Prompting"☆106Updated last year
- [ACL 2024] Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View☆114Updated 10 months ago
- ToolBench, an evaluation suite for LLM tool manipulation capabilities.☆150Updated last year
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆478Updated 5 months ago
- ☆176Updated 2 months ago