Alternatives and similar repositories for GEM-metrics:

Users that are interested in GEM-metrics are comparing it to the libraries listed below

• jacobandreas / geca
  ☆42Updated 4 years ago
• naver / gdc
  Code accompanying our papers on the "Generative Distributional Control" framework
  ☆118Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• yanaiela / pararel
  ☆44Updated last year
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆114Updated last year
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆99Updated 2 years ago
• TevenLeScao / pet
  This repository contains the code for "How many data points is a prompt worth?"
  ☆48Updated 4 years ago
• Shikib / usr
  Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…
  ☆50Updated 2 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆96Updated 2 years ago
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• INK-USC / CrossFit
  Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)
  ☆110Updated 2 years ago
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆137Updated 3 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• neulab / retomaton
  PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)
  ☆71Updated 2 years ago
• berlino / tensor2struct-public
  Semantic parsers based on encoder-decoder framework
  ☆92Updated 2 years ago
• krishnap25 / mauve-experiments
  ☆38Updated 11 months ago
• GXimingLu / Quark
  ☆75Updated last year
• microsoft / CLUES
  ☆34Updated 2 years ago
• AkariAsai / evidentiality_qa
  The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).
  ☆43Updated 2 years ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆88Updated 3 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 3 years ago
• martiansideofthemoon / rankgen
  Official code and model checkpoints for our EMNLP 2022 paper "RankGen - Improving Text Generation with Large Ranking Models" (https://arx…
  ☆136Updated last year
• yanaiela / amnesic_probing
  ☆39Updated 3 years ago
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 3 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• HanGuo97 / soft-Q-learning-for-text-generation
  ☆67Updated 2 years ago