Alternatives and similar repositories for CREPE

Users that are interested in CREPE are comparing it to the libraries listed below

• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆82Updated 4 years ago
• GXimingLu / neurologic_decoding
  ☆82Updated 2 years ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆57Updated 2 years ago
• google-research-datasets / answer-equivalence-dataset
  This dataset contains human judgements about answer equivalence. The data is based on SQuAD (Stanford Question Answering Dataset), and co…
  ☆26Updated 2 years ago
• McGill-NLP / FaithDial
  ☆48Updated 2 years ago
• Yixiao-Song / VeriScore
  ☆23Updated 7 months ago
• ThomasScialom / QuestEval
  ☆98Updated last year
• salesforce / QAFactEval
  ☆49Updated 2 years ago
• danieldeutsch / qaeval
  ☆15Updated 3 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 3 years ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆41Updated last year
• jacobandreas / geca
  ☆42Updated 4 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Updated 2 years ago
• easonnie / ChaosNLI
  [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data
  ☆37Updated 3 years ago
• Liyan06 / AggreFact
  Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
  ☆25Updated last year
• AkariAsai / unanswerable_qa
  The official implementation for ACL 2021 "Challenges in Information Seeking QA: Unanswerable Questions and Paragraph Retrieval".
  ☆27Updated 4 years ago
• Yale-LILY / ROSE
  ☆39Updated 2 years ago
• wjko2 / DCQA-Discourse-Comprehension-by-Question-Answering
  ☆9Updated 2 years ago
• dapascual / K2T
  ☆71Updated 3 years ago
• najoungkim / COGS
  ☆61Updated 2 years ago
• tylerachang / multilingual-geometry
  The geometry of multilingual language model representations (EMNLP 2022).
  ☆21Updated 2 years ago
• allenai / contrast-sets
  ☆59Updated 2 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆115Updated 2 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated last year
• tanyuqian / ctc-gen-eval
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆97Updated 2 years ago
• katherinethai / par3
  ☆28Updated 7 months ago
• Shikib / usr
  Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…
  ☆50Updated 2 years ago
• marzenakrp / demetr
  Repository for DEMETR: Diagnosing Evaluation Metrics for Translation
  ☆15Updated 2 years ago
• jzbjyb / lm-calibration
  ☆35Updated 3 years ago