GEM-benchmark / GEM-metricsLinks
Automatic metrics for GEM tasks
☆67Updated 3 years ago
Alternatives and similar repositories for GEM-metrics
Users that are interested in GEM-metrics are comparing it to the libraries listed below
Sorting:
- Code accompanying our papers on the "Generative Distributional Control" framework☆118Updated 2 years ago
- DEMix Layers for Modular Language Modeling☆54Updated 4 years ago
- ☆42Updated 4 years ago
- code associated with ACL 2021 DExperts paper☆117Updated 2 years ago
- Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)☆112Updated 3 years ago
- The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".☆69Updated last year
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 3 years ago
- ☆101Updated 3 years ago
- The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).☆45Updated 2 years ago
- Code for Editing Factual Knowledge in Language Models☆141Updated 3 years ago
- ☆38Updated last year
- EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation☆98Updated 2 years ago
- ☆58Updated 3 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Updated 4 years ago
- ☆97Updated 3 years ago
- ☆35Updated 3 years ago
- ☆50Updated 2 years ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 4 years ago
- ☆46Updated last year
- ☆71Updated 3 years ago
- Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)☆80Updated last year
- ☆75Updated last year
- An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"☆119Updated 3 years ago
- Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".☆58Updated 5 years ago
- [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data☆40Updated 3 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Updated 3 years ago
- ☆325Updated 4 years ago
- ☆41Updated 4 years ago
- ☆112Updated 3 years ago
- Benchmark API for Multidomain Language Modeling☆25Updated 3 years ago