Alternatives and similar repositories for summac:

Users that are interested in summac are comparing it to the libraries listed below

• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆52Updated 2 years ago
• mcao516 / EntFA
  ☆25Updated 2 years ago
• salesforce / QAFactEval
  ☆44Updated last year
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆115Updated last year
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 2 years ago
• ThomasScialom / QuestEval
  ☆92Updated 10 months ago
• Yale-LILY / ROSE
  ☆36Updated last year
• exe1023 / DialEvalMetrics
  ☆62Updated 2 years ago
• shmsw25 / Channel-LM-Prompting
  An original implementation of "Noisy Channel Language Model Prompting for Few-Shot Text Classification"
  ☆131Updated 2 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆47Updated last year
• DevSinghSachan / art
  Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
  ☆62Updated 2 years ago
• tagoyal / factuality-datasets
  ☆45Updated last year
• DevSinghSachan / unsupervised-passage-reranking
  Code, datasets, and checkpoints for the paper "Improving Passage Retrieval with Zero-Shot Question Generation (EMNLP 2022)"
  ☆99Updated 2 years ago
• amazon-science / bold
  Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper
  ☆70Updated 3 years ago
• dapascual / K2T
  ☆70Updated 3 years ago
• realtimeqa / realtimeqa_public
  ☆70Updated 11 months ago
• Yale-LILY / dart
  Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"
  ☆148Updated 2 years ago
• awebson / prompt_semantics
  This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”
  ☆85Updated 2 years ago
• diyiy / ACL2022_Limited_Data_Learning_Tutorial
  ☆93Updated 2 years ago
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆54Updated 3 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated last year
• GXimingLu / neurologic_decoding
  ☆81Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆93Updated last year
• Liyan06 / AggreFact
  Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
  ☆23Updated 9 months ago
• ryokamoi / wice
  This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.
  ☆40Updated last year
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆128Updated last month
• W4ngatang / qags
  Question Answering and Generation for Summarization
  ☆68Updated 2 years ago
• yuh-zha / AlignScore
  ACL2023 - AlignScore, a metric for factual consistency evaluation.
  ☆119Updated 10 months ago
• salesforce / DialFact
  We construct and introduce DIALFACT, a testing benchmark dataset crowd-annotated conversational claims, paired with pieces of evidence fr…
  ☆41Updated 2 years ago