Alternatives and similar repositories for GEM-metrics

Users that are interested in GEM-metrics are comparing it to the libraries listed below

• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆54Updated 4 years ago
• naver / gdc
  Code accompanying our papers on the "Generative Distributional Control" framework
  ☆118Updated 2 years ago
• INK-USC / CrossFit
  Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)
  ☆112Updated 3 years ago
• AkariAsai / evidentiality_qa
  The official implemetation of "Evidentiality-guided Generation for Knowledge-Intensive NLP Tasks" (NAACL 2022).
  ☆45Updated 2 years ago
• tau-nlp / scrolls
  The official code of EMNLP 2022, "SCROLLS: Standardized CompaRison Over Long Language Sequences".
  ☆70Updated last year
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆117Updated 2 years ago
• jacobandreas / geca
  ☆42Updated 4 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 3 years ago
• nicola-decao / KnowledgeEditor
  Code for Editing Factual Knowledge in Language Models
  ☆141Updated 3 years ago
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆98Updated 2 years ago
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆100Updated 3 years ago
• yanaiela / pararel
  ☆46Updated last year
• jzbjyb / lm-calibration
  ☆35Updated 3 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• kernelmachine / demix-data
  Benchmark API for Multidomain Language Modeling
  ☆25Updated 3 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆39Updated 2 years ago
• rycolab / uid-decoding
  ☆41Updated 4 years ago
• shmsw25 / AmbigQA
  An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"
  ☆119Updated 3 years ago
• easonnie / ChaosNLI
  [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data
  ☆40Updated 3 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Updated 4 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• allenai / flex
  Few-shot NLP benchmark for unified, rigorous eval
  ☆92Updated 3 years ago
• McGill-NLP / FaithDial
  ☆50Updated 2 years ago
• krishnap25 / mauve-experiments
  ☆38Updated last year
• vipulraheja / iterater
  Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)
  ☆80Updated last year
• GXimingLu / Quark
  ☆75Updated last year
• machelreid / m2d2
  M2D2: A Massively Multi-domain Language Modeling Dataset (EMNLP 2022) by Machel Reid, Victor Zhong, Suchin Gururangan, Luke Zettlemoyer
  ☆54Updated 2 years ago
• dapascual / K2T
  ☆71Updated 3 years ago
• jxhe / efficient-knnlm
  Pytorch implementation of paper "Efficient Nearest Neighbor Language Models" (EMNLP 2021)
  ☆74Updated 3 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago