thu-coai / OpenMEVA
Benchmark for evaluating open-ended generation
☆48Updated 4 months ago
Alternatives and similar repositories for OpenMEVA:
Users that are interested in OpenMEVA are comparing it to the libraries listed below
- ☆32Updated last year
- Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"☆117Updated last year
- ☆90Updated 11 months ago
- ☆82Updated last year
- UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation☆58Updated 4 years ago
- Codes for our paper "CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation" (ACL 2022)☆31Updated 2 years ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆41Updated 2 years ago
- [COLING22] An End-to-End Library for Evaluating Natural Language Generation☆90Updated last year
- TBC☆26Updated 2 years ago
- Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…☆50Updated 2 years ago
- Code for Editing Factual Knowledge in Language Models☆136Updated 3 years ago
- ☆71Updated 3 years ago
- Code and Models for the paper "End-to-End Training of Multi-Document Reader and Retriever for Open-Domain Question Answering" (NeurIPS 20…☆109Updated 2 years ago
- ☆43Updated last year
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Updated 2 years ago
- Lexically constrained text generation with CBART.☆48Updated 2 years ago
- ☆61Updated 2 years ago
- ☆47Updated 2 years ago
- ☆45Updated last year
- The Official Repository for the Automatic Dialogue Evaluation Sub-task of DSTC10 Track 5 (Automatic Evaluation and Moderation of Open-dom…☆19Updated 3 years ago
- EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation☆96Updated last year
- Code base of In-Context Learning for Dialogue State tracking☆45Updated last year
- First explanation metric (diagnostic report) for text generation evaluation☆62Updated last week
- Multilingual Pre-training with Language and Task Adaptation for Multilingual Text Style Transfer (ACL 2022)☆9Updated 2 years ago
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System (ACL 2022)☆159Updated last year
- Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning☆99Updated last year
- Official Code for NAACL 2022 paper: "Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generation"☆16Updated 2 years ago
- ☆36Updated 11 months ago
- Source code for paper on commonsense reasoning for 2020 Annual Conference of the Association for Computational Linguistics (ACL) 2020.☆28Updated 7 months ago
- ☆62Updated 2 years ago