thunlp / ChatEval
Codes for our paper "ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate"
☆277Updated 6 months ago
Alternatives and similar repositories for ChatEval:
Users that are interested in ChatEval are comparing it to the libraries listed below
- papers related to LLM-agent that published on top conferences☆314Updated last week
- An Analytical Evaluation Board of Multi-turn LLM Agents [NeurIPS 2024 Oral]☆308Updated 11 months ago
- ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels …☆257Updated last year
- MAD: The first work to explore Multi-Agent Debate with Large Language Models :D☆366Updated 3 months ago
- FireAct: Toward Language Agent Fine-tuning☆275Updated last year
- Data and Code for Program of Thoughts (TMLR 2023)☆268Updated 11 months ago
- LLMs can generate feedback on their work, use it to improve the output, and repeat this process iteratively.☆679Updated 6 months ago
- Official implementation of paper "Cumulative Reasoning With Large Language Models" (https://arxiv.org/abs/2308.04371)☆292Updated 7 months ago
- [EMNLP 2023] Enabling Large Language Models to Generate Text with Citations. Paper: https://arxiv.org/abs/2305.14627☆480Updated 6 months ago
- Generative Judge for Evaluating Alignment☆236Updated last year
- Official Implementation of Dynamic LLM-Agent Network: An LLM-agent Collaboration Framework with Agent Team Optimization☆136Updated 11 months ago
- [ACL 2024] AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning☆221Updated 3 months ago
- Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".☆230Updated 10 months ago
- [NAACL 2025] KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents☆215Updated 2 months ago
- ICML 2024: Improving Factuality and Reasoning in Language Models through Multiagent Debate☆427Updated last year
- Repository for Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questions, ACL23☆203Updated 10 months ago
- [NeurIPS 2023] Codebase for the paper: "Guiding Large Language Models with Directional Stimulus Prompting"☆108Updated last year
- ☆132Updated 4 months ago
- Source code for the paper "Active Prompting with Chain-of-Thought for Large Language Models"☆237Updated 11 months ago
- The repository for the survey paper <<Survey on Large Language Models Factuality: Knowledge, Retrieval and Domain-Specificity>>☆337Updated last year
- ☆278Updated last year
- ☆216Updated last year
- ☆179Updated 2 months ago
- Repo for paper "Unleashing Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration"☆328Updated 11 months ago
- A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.☆143Updated last week
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)☆262Updated last year
- This is the repository for the Tool Learning survey.☆359Updated last month
- Github repository for "RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models"☆170Updated 4 months ago
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆463Updated last year
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them☆482Updated 10 months ago