thu-coai / OpenMEVA
Benchmark for evaluating open-ended generation
☆48Updated 5 months ago
Alternatives and similar repositories for OpenMEVA:
Users that are interested in OpenMEVA are comparing it to the libraries listed below
- ☆90Updated last year
- Code and data for "Retrieval Enhanced Model for Commonsense Generation" (ACL-IJCNLP 2021).☆28Updated 3 years ago
- Technical Report: Is ChatGPT a Good NLG Evaluator? A Preliminary Study☆43Updated 2 years ago
- ☆32Updated last month
- UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation☆58Updated 4 years ago
- We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…☆41Updated 2 years ago
- Code for the paper Code for the paper InstructDial: Improving Zero and Few-shot Generalization in Dialogue through Instruction Tuning☆100Updated last year
- [ACL 2022] Ditch the Gold Standard: Re-evaluating Conversational Question Answering☆45Updated 2 years ago
- Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…☆50Updated 2 years ago
- EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation☆96Updated 2 years ago
- Codes for our paper "CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation" (ACL 2022)☆31Updated 2 years ago
- Code repository for our EMNLP 2020 long paper "Modeling Protagonist Emotions for Emotion-Aware Storytelling" (https://arxiv.org/abs/2010.…☆20Updated 4 years ago
- First explanation metric (diagnostic report) for text generation evaluation☆61Updated last month
- Repository for ACL 2022 paper Mix and Match: Learning-free Controllable Text Generation using Energy Language Models☆42Updated 3 years ago
- ☆71Updated 3 years ago
- TBC☆26Updated 2 years ago
- A Repo to curate all creative NLG papers☆81Updated 2 years ago
- Question Answering and Generation for Summarization☆68Updated 2 years ago
- ☆36Updated last year
- ☆35Updated last year
- ☆82Updated 2 years ago
- Official Github repo for the paper "Evaluating the Evaluation of Diversity in Natural Language Generation"☆19Updated 4 years ago
- This respository contains the code for extracting the test samples we used in our paper: "A Multitask, Multilingual, Multimodal Evaluatio…☆77Updated last year
- Official Code for NAACL 2022 paper: "Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generation"☆16Updated 2 years ago
- Code for Editing Factual Knowledge in Language Models☆137Updated 3 years ago
- Efficient Memory-Augmented Transformers☆34Updated 2 years ago
- Lexically constrained text generation with CBART.☆48Updated 2 years ago
- ☆57Updated 2 years ago
- The Official Repository for the Automatic Dialogue Evaluation Sub-task of DSTC10 Track 5 (Automatic Evaluation and Moderation of Open-dom…☆19Updated 3 years ago
- ☆58Updated 2 years ago