Alternatives and similar repositories for GEM-metrics

Users that are interested in GEM-metrics are comparing it to the libraries listed below

• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• naver / gdc
  Code accompanying our papers on the "Generative Distributional Control" framework
  ☆118Updated 2 years ago
• yanaiela / pararel
  ☆44Updated last year
• jacobandreas / geca
  ☆42Updated 4 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆100Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• HanGuo97 / soft-Q-learning-for-text-generation
  ☆68Updated 2 years ago
• timoschick / self-debiasing
  This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".
  ☆88Updated 3 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆115Updated 2 years ago
• lena-voita / description-length-probing
  This is a repository with the code for the EMNLP 2020 paper "Information-Theoretic Probing with Minimum Description Length"
  ☆71Updated 10 months ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• belindal / state-probes
  Code for the paper "Implicit Representations of Meaning in Neural Language Models"
  ☆54Updated 2 years ago
• anthonywchen / MOCHA
  Code & data for EMNLP 2020 paper "MOCHA: A Dataset for Training and Evaluating Reading Comprehension Metrics".
  ☆16Updated 3 years ago
• AkariAsai / evidentiality_qa
  The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).
  ☆43Updated 2 years ago
• Pascalson / LERG
  A unified approach to explain conditional text generation models. Pytorch. The code of paper "Local Explanation of Dialogue Response Gene…
  ☆17Updated 3 years ago
• qkaren / unsup_gen_for_cms_reasoning
  ☆49Updated 2 years ago
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• McGill-NLP / FaithDial
  ☆48Updated 2 years ago
• jifan-chen / QA-Verification-Via-NLI
  Code and dataset for the EMNLP 2021 Finding paper "Can NLI Models Verify QA Systems’ Predictions?"
  ☆25Updated last year
• google-deepmind / streamingqa
  ☆48Updated last year
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 4 years ago
• nyu-mll / SQuALITY
  Query-focused summarization data
  ☆41Updated 2 years ago
• neulab / retomaton
  PyTorch code for the RetoMaton paper: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022)
  ☆73Updated 2 years ago
• GXimingLu / Quark
  ☆75Updated last year
• archiki / GrIPS
  Code for our paper: "GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language Models"
  ☆55Updated 2 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆91Updated 2 years ago
• peterbhase / LAS-NL-Explanations
  Code for paper "Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?"
  ☆22Updated 4 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• qkaren / COLD_decoding
  ☆107Updated 3 years ago