marzenakrp / demetrLinks
Repository for DEMETR: Diagnosing Evaluation Metrics for Translation
☆15Updated 2 years ago
Alternatives and similar repositories for demetr
Users that are interested in demetr are comparing it to the libraries listed below
Sorting:
- ☆28Updated 8 months ago
- Code and data for the NAACL 2021 paper: "XFORMAL: A Benchmark for Multilingual Formality Style Transfer"☆12Updated 4 years ago
- ☆15Updated 4 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆114Updated 5 months ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Updated 4 years ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆16Updated 9 months ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆15Updated 2 weeks ago
- ☆71Updated 3 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆144Updated 2 years ago
- ☆100Updated last year
- M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer☆54Updated 2 years ago
- Pretraining scripts for BART transformer model☆12Updated 2 years ago
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆58Updated 5 years ago
- Tool to perform paired evaluation of automatic systems☆12Updated 3 years ago
- ☆30Updated 2 years ago
- A software for transferring pre-trained English models to foreign languages☆18Updated 2 years ago
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆30Updated 3 years ago
- ☆25Updated 2 years ago
- A framework for evaluating Machine Translation models.☆10Updated 3 months ago
- ☆58Updated 3 years ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆58Updated 2 years ago
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆31Updated 2 years ago
- Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…☆22Updated 2 years ago
- ☆51Updated 2 years ago
- a tool for calcualting character n-gram F score☆73Updated 2 years ago
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆18Updated 2 years ago
- ☆59Updated 2 years ago
- ☆91Updated 11 months ago
- Codebase, data and models for the Keep it Simple paper at ACL2021☆38Updated 2 years ago