zouharvi / subset2evaluateLinks
Find informative examples to efficiently (human)-evaluate NLG models.
☆11Updated 2 weeks ago
Alternatives and similar repositories for subset2evaluate
Users that are interested in subset2evaluate are comparing it to the libraries listed below
Sorting:
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 3 years ago
- ☆28Updated 7 months ago
- ☆54Updated 3 years ago
- Code and data for the NAACL 2021 paper: "XFORMAL: A Benchmark for Multilingual Formality Style Transfer"☆12Updated 4 years ago
- Repository for DEMETR: Diagnosing Evaluation Metrics for Translation☆15Updated 2 years ago
- ☆30Updated 2 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆110Updated 4 months ago
- Tool to perform paired evaluation of automatic systems☆12Updated 3 years ago
- This dataset contains human judgements about answer equivalence. The data is based on SQuAD (Stanford Question Answering Dataset), and co…☆26Updated 2 years ago
- Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…☆22Updated 2 years ago
- ☆39Updated 4 years ago
- A framework for evaluating Machine Translation models.☆10Updated last month
- ☆9Updated 2 years ago
- Measuring the Mixing of Contextual Information in the Transformer☆30Updated 2 years ago
- CD20200004 from 01/01/2021 to 31/12/2023 - LIG UGA - Python Notebook and Models for the MT Lab @ ALPS 2022☆13Updated last year
- A software for transferring pre-trained English models to foreign languages☆18Updated 2 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆21Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆82Updated 4 years ago
- A simple library for querying the URIEL typological database.☆91Updated last year
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆25Updated 4 months ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆144Updated 2 years ago
- The Benchmark of Linguistic Minimal Pairs☆152Updated 2 years ago
- MT Evaluation in Many Languages via Zero-Shot Paraphrasing☆101Updated 11 months ago
- Code and Data for Evaluation WG☆41Updated 3 years ago
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆31Updated 2 years ago
- Pretraining scripts for BART transformer model☆11Updated 2 years ago
- Repository for DISRPT2023 shared task☆17Updated 11 months ago
- Data for evaluating gender bias in coreference resolution systems.☆79Updated 6 years ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆18Updated 2 years ago
- Neural CRF Model for Sentence Alignment in Text Simplification☆68Updated 5 months ago