zouharvi / subset2evaluateLinks
Find informative examples to efficiently (human)-evaluate NLG models.
☆16Updated last month
Alternatives and similar repositories for subset2evaluate
Users that are interested in subset2evaluate are comparing it to the libraries listed below
Sorting:
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 3 years ago
- ☆28Updated 9 months ago
- ☆54Updated 3 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆21Updated 2 years ago
- Code and data for the NAACL 2021 paper: "XFORMAL: A Benchmark for Multilingual Formality Style Transfer"☆12Updated 4 years ago
- ☆39Updated 4 years ago
- ☆30Updated 2 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆184Updated last year
- Repository for DEMETR: Diagnosing Evaluation Metrics for Translation☆15Updated 2 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆115Updated 6 months ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆145Updated 2 years ago
- Tool to perform paired evaluation of automatic systems☆12Updated 3 years ago
- A repository with the code related to experiments around context-aware machine translation☆51Updated 3 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Updated 4 years ago
- ☆17Updated 3 months ago
- This project collects methods that enhance the comparison between AMR graphs.☆16Updated 2 years ago
- Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…☆22Updated 2 years ago
- Data for evaluating gender bias in coreference resolution systems.☆80Updated 6 years ago
- ☆41Updated 2 years ago
- Diagnostic tests for linguistic capacities in language models☆65Updated 3 years ago
- Repository for DISRPT2023 shared task☆17Updated last year
- ☆15Updated 4 years ago
- ☆21Updated 3 years ago
- Codebase, data and models for the SummaC paper in TACL☆100Updated 7 months ago
- A framework for evaluating Machine Translation models.☆10Updated 3 months ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆18Updated 2 years ago
- Pretraining scripts for BART transformer model☆12Updated 2 years ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated 2 years ago
- TSAR2022 Shared Task on Lexical Simplification - Datasets and Evaluation scripts☆10Updated 2 years ago
- ☆15Updated 3 years ago