Alternatives and similar repositories for summac:

Users that are interested in summac are comparing it to the libraries listed below

• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆54Updated 2 years ago
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆81Updated 4 years ago
• salesforce / QAFactEval
  ☆44Updated last year
• Yale-LILY / ROSE
  ☆38Updated last year
• mcao516 / EntFA
  ☆25Updated 2 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated last year
• ThomasScialom / QuestEval
  ☆95Updated last year
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆117Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆94Updated last year
• exe1023 / DialEvalMetrics
  ☆62Updated 2 years ago
• shmsw25 / Channel-LM-Prompting
  An original implementation of "Noisy Channel Language Model Prompting for Few-Shot Text Classification"
  ☆131Updated 2 years ago
• google-research / true
  Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".
  ☆76Updated last week
• tagoyal / factuality-datasets
  ☆45Updated last year
• danieldeutsch / sacrerouge
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆141Updated 2 years ago
• McGill-NLP / FaithDial
  ☆48Updated 2 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Updated last year
• Yale-LILY / dart
  Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"
  ☆152Updated 2 years ago
• dapascual / K2T
  ☆71Updated 3 years ago
• Yale-LILY / DYLE
  Repository for ACL'22 paper: Dynamic Latent Extraction for Abstractive Long-Input Summarization
  ☆55Updated last year
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆114Updated last year
• shmsw25 / AmbigQA
  An original implementation of EMNLP 2020, "AmbigQA: Answering Ambiguous Open-domain Questions"
  ☆118Updated 2 years ago
• peterwestuw / surface-form-competition
  ☆58Updated 2 years ago
• stangelid / qt
  ☆44Updated 3 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 2 years ago
• thu-coai / CTRLEval
  Codes for our paper "CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation" (ACL 2022)
  ☆31Updated 2 years ago
• amazon-science / summary-reference-revision
  ☆19Updated 11 months ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 2 weeks ago
• mingdachen / WikiTableT
  Code, data, and pretrained models for the paper "Generating Wikipedia Article Sections from Diverse Data Sources"
  ☆20Updated 4 years ago
• Yixiao-Song / VeriScore
  ☆18Updated 3 months ago
• salesforce / factCC
  Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
  ☆292Updated last year