marzenakrp / demetr
Repository for DEMETR: Diagnosing Evaluation Metrics for Translation
☆14Updated last year
Related projects: ⓘ
- ☆19Updated last year
- ☆13Updated 3 years ago
- An original implementation of the paper "CREPE: Open-Domain Question Answering with False Presuppositions"☆14Updated last year
- A Dataset for Tuning and Evaluation of Sentence Simplification Models with Multiple Rewriting Transformations☆54Updated 2 years ago
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆85Updated last month
- ☆23Updated last year
- UDapter is a multilingual dependency parser that uses "contextual" adapters together with language-typology features for language-specifi…☆30Updated last year
- a tool for calcualting character n-gram F score☆65Updated last year
- ☆70Updated 2 years ago
- Data and code accompanying the paper "As Little as Possible, as Much as Necessary: Detecting Over- and Undertranslations with Contrastive…☆20Updated last year
- Official code for LEWIS, from: "LEWIS: Levenshtein Editing for Unsupervised Text Style Transfer", ACL-IJCNLP 2021 Findings by Machel Rei…☆31Updated last year
- This repository houses the IMPlicature and PRESupposition diagnostic dataset (IMPPRES), consisting of >25k semiautomatically generated se…☆19Updated 3 years ago
- ☆74Updated 3 weeks ago
- ☆39Updated last year
- A repository for experiments in quality-aware decoding☆14Updated 2 years ago
- REALSumm: Re-evaluating Evaluation in Text Summarization☆71Updated last year
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆59Updated 4 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆15Updated last year
- FRANK: Factuality Evaluation Benchmark☆51Updated last year
- PyTorch source code of NAACL 2021 paper "Improving the Lexical Ability of Pretrained Language Models for Unsupervised Neural Machine Tran…☆17Updated last year
- ☆19Updated last year
- A repository with the code related to experiments around context-aware machine translation☆48Updated 2 years ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆21Updated last year
- ☆14Updated 3 years ago
- ☆18Updated 7 months ago
- Python source code for EMNLP 2020 paper "Reusing a Pretrained Language Model on Languages with Limited Corpora for Unsupervised NMT".☆35Updated 2 years ago
- ☆60Updated last year
- Code and data for the NAACL 2021 paper: "XFORMAL: A Benchmark for Multilingual Formality Style Transfer"☆12Updated 3 years ago
- ☆11Updated 10 months ago
- Pytorch Implementation of EncT5: Fine-tuning T5 Encoder for Non-autoregressive Tasks☆62Updated 2 years ago