Alternatives and similar repositories for GEM-metrics:

Users that are interested in GEM-metrics are comparing it to the libraries listed below

• jacobandreas / geca
  ☆42Updated 4 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• yanaiela / pararel
  ☆44Updated last year
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• naver / gdc
  Code accompanying our papers on the "Generative Distributional Control" framework
  ☆117Updated 2 years ago
• krishnap25 / mauve-experiments
  ☆35Updated 9 months ago
• AkariAsai / evidentiality_qa
  The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).
  ☆43Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆69Updated last year
• neulab / retomaton
  PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)
  ☆71Updated 2 years ago
• qkaren / unsup_gen_for_cms_reasoning
  ☆49Updated last year
• TevenLeScao / pet
  This repository contains the code for "How many data points is a prompt worth?"
  ☆48Updated 3 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 2 years ago
• lil-lab / bandit-qa
  Code for the paper "Simulating Bandit Learning from User Feedback for Extractive Question Answering".
  ☆18Updated 2 years ago
• jifan-chen / QA-Verification-Via-NLI
  Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"
  ☆25Updated last year
• Shikib / usr
  Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…
  ☆50Updated 2 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆40Updated last year
• danieldeutsch / qaeval
  ☆15Updated 3 years ago
• suzgunmirac / crowd-sampling
  Follow the Wisdom of the Crowd: Effective Text Generation via Minimum Bayes Risk Decoding
  ☆18Updated 2 years ago
• cindyxinyiwang / expand-via-lexicon-based-adaptation
  Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"
  ☆30Updated 2 years ago
• McGill-NLP / FaithDial
  ☆47Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆96Updated last year
• HanGuo97 / soft-Q-learning-for-text-generation
  ☆67Updated 2 years ago
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆98Updated 2 years ago
• qqaatw / pytorch-realm-orqa
  PyTorch reimplementation of REALM and ORQA
  ☆22Updated 3 years ago
• jzbjyb / lm-calibration
  ☆33Updated 3 years ago
• alon-albalak / TLiDB
  Transfer Learning in Dialogue Benchmarking Toolkit
  ☆14Updated last year
• swj0419 / kNN_prompt
  TBC
  ☆26Updated 2 years ago
• anthonywchen / MOCHA
  Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".
  ☆16Updated 2 years ago
• roeeaharoni / unsupervised-domain-clusters
  Code and data accompanying our ACL 2020 paper, "Unsupervised Domain Clusters in Pretrained Language Models".
  ☆58Updated 4 years ago