Repository for DEMETR: Diagnosing Evaluation Metrics for Translation
☆17Nov 29, 2022Updated 3 years ago
Alternatives and similar repositories for demetr
Users that are interested in demetr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official codebase accompanying our ACL 2022 paper "RELiC: Retrieving Evidence for Literary Claims" (https://relic.cs.umass.edu).☆20May 14, 2022Updated 4 years ago
- ☆29Dec 2, 2024Updated last year
- ☆24Apr 2, 2024Updated 2 years ago
- Building and Using A Seed Corpus for the Human Language Project☆11Feb 9, 2018Updated 8 years ago
- [EMNLP2025] Remedy: Learning Machine Translation Evaluation from Human Preferences with Reward Modeling☆16Nov 20, 2025Updated 8 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Tools for evaluating the performance of MT metrics on data from recent WMT metrics shared tasks.☆133Apr 23, 2026Updated 3 months ago
- Code and data for the IWSLT 2022 shared task on Formality Control for SLT☆22May 24, 2023Updated 3 years ago
- Neural Fuzzy Repair (NFR) is a data augmentation pipeline, which integrates fuzzy matches (i.e. similar translations) into neural machine…☆12Aug 14, 2024Updated 2 years ago
- ☆18Mar 20, 2019Updated 7 years ago
- [ChatGPT4MTevaluation] ErrorAnalysis Prompt for MT Evaluation in ChatGPT☆91Oct 14, 2025Updated 10 months ago
- Repository for "BLEU Meets COMET: Combining Lexical and Neural Metrics Towards Robust Machine Translation Evaluation", accepted at EAMT 2…☆21Jul 19, 2023Updated 3 years ago
- Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…☆140Aug 2, 2023Updated 3 years ago
- Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".☆16May 3, 2022Updated 4 years ago
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆13Jan 30, 2023Updated 3 years ago
- ☆54Oct 24, 2024Updated last year
- A repository with the code related to experiments around context-aware machine translation☆51Sep 22, 2025Updated 10 months ago
- NLP course @ CS Faculty, HSE☆15Mar 4, 2020Updated 6 years ago
- Minimum Bayes Risk Decoding for Hugging Face Transformers☆61Jun 3, 2024Updated 2 years ago
- ☆22Sep 19, 2023Updated 2 years ago
- A Neural Framework for MT Evaluation☆774Apr 21, 2026Updated 3 months ago
- ☆74Jul 2, 2021Updated 5 years ago
- Data and all☆14Sep 30, 2019Updated 6 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Examples for the Spartan HPC cluster.☆10Sep 2, 2019Updated 6 years ago
- explainable-machine-translation-metrics☆12Jul 15, 2022Updated 4 years ago
- GEMBA — GPT Estimation Metric Based Assessment☆154Dec 15, 2025Updated 8 months ago
- Multilingual Quality Estimation and Automatic Post-editing Dataset☆44Mar 24, 2022Updated 4 years ago
- Official repository for our NeurIPS 2023 paper "Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense…☆203Nov 9, 2023Updated 2 years ago
- EMNLP DiscoEval paper☆43Nov 12, 2019Updated 6 years ago
- UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation☆59Oct 13, 2020Updated 5 years ago
- ☆33Nov 22, 2021Updated 4 years ago
- Text Simplification System and Dataset☆15Jul 19, 2017Updated 9 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DiffusER: Discrete Diffusion via Edit-based Reconstruction (Reid, Hellendoorn & Neubig, 2022)☆55Aug 3, 2025Updated last year
- The Shmoop Corpus☆17Oct 27, 2020Updated 5 years ago
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆14Jul 22, 2025Updated last year
- FrugalScore is an approach to learn a fixed, low cost version of any expensive NLG metric, while retaining most of its original performan…☆16Sep 21, 2022Updated 3 years ago
- BLEURT implementation in PyTorch☆38Jan 19, 2023Updated 3 years ago
- An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)☆10May 31, 2024Updated 2 years ago
- ☆12Jun 5, 2024Updated 2 years ago