Alternatives and similar repositories for summac

Users that are interested in summac are comparing it to the libraries listed below

• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆58Updated 2 years ago
• Yale-LILY / ROSE
  ☆39Updated 2 years ago
• salesforce / factCC
  Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
  ☆303Updated 3 months ago
• salesforce / QAFactEval
  ☆50Updated 2 years ago
• mcao516 / EntFA
  ☆27Updated 2 years ago
• ThomasScialom / QuestEval
  ☆100Updated last year
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆132Updated last year
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Updated 4 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated 2 years ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆123Updated last year
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆96Updated 2 years ago
• exe1023 / DialEvalMetrics
  ☆62Updated 2 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆115Updated 2 years ago
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆56Updated 4 years ago
• dapascual / K2T
  ☆71Updated 3 years ago
• neulab / BARTScore
  BARTScore: Evaluating Generated Text as Text Generation
  ☆357Updated 3 years ago
• DevSinghSachan / art
  Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
  ☆63Updated 2 years ago
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆206Updated last year
• tagoyal / factuality-datasets
  ☆46Updated 2 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Updated 2 years ago
• Yixiao-Song / VeriScore
  ☆28Updated 8 months ago
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆100Updated 2 years ago
• acl-org / responsibleNLPresearch
  templates and other documents regarding responsible NLP research
  ☆70Updated 2 years ago
• stangelid / qt
  ☆44Updated 4 years ago
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆25Updated 2 weeks ago
• s-nlp / paradetox
  Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"
  ☆31Updated 4 months ago
• McGill-NLP / bias-bench
  ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.
  ☆144Updated this week
• McGill-NLP / FaithDial
  ☆51Updated 2 years ago
• GXimingLu / a_star_neurologic
  ☆43Updated 2 years ago