Alternatives and similar repositories for summac

Users that are interested in summac are comparing it to the libraries listed below

• artidoro / frank
  FRANK: Factuality Evaluation Benchmark
  ☆59Updated 3 years ago
• mcao516 / EntFA
  ☆27Updated 3 years ago
• salesforce / QAFactEval
  ☆55Updated 2 years ago
• salesforce / factCC
  Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
  ☆307Updated 8 months ago
• Yale-LILY / QMSum
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆141Updated 2 years ago
• psunlpgroup / MACSum
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Updated 2 years ago
• s-nlp / paradetox
  Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"
  ☆33Updated 9 months ago
• Yale-LILY / ROSE
  ☆39Updated 2 years ago
• ThomasScialom / QuestEval
  ☆102Updated last year
• google-research-datasets / xsum_hallucination_annotations
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Updated 5 years ago
• microsoft / HaDes
  Token-level Reference-free Hallucination Detection
  ☆97Updated 2 years ago
• exe1023 / DialEvalMetrics
  ☆62Updated 3 years ago
• neulab / BARTScore
  BARTScore: Evaluating Generated Text as Text Generation
  ☆367Updated 3 years ago
• W4ngatang / sent-bias
  Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.
  ☆56Updated 4 years ago
• violet-zct / fairseq-detect-hallucination
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Updated 3 years ago
• thu-coai / CTRLEval
  Codes for our paper "CTRLEval: An Unsupervised Reference-Free Metric for Evaluating Controlled Text Generation" (ACL 2022)
  ☆33Updated 3 years ago
• GXimingLu / a_star_neurologic
  ☆43Updated 2 years ago
• tagoyal / factuality-datasets
  ☆46Updated 2 years ago
• maszhongming / UniEval
  Repository for EMNLP 2022 Paper: Towards a Unified Multi-Dimensional Evaluator for Text Generation
  ☆214Updated last year
• acl-org / responsibleNLPresearch
  templates and other documents regarding responsible NLP research
  ☆70Updated 2 years ago
• esdurmus / feqa
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Updated 2 years ago
• Betswish / Cross-Lingual-Consistency
  Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…
  ☆27Updated 5 months ago
• McGill-NLP / FaithDial
  ☆50Updated 2 years ago
• alisawuffles / DExperts
  code associated with ACL 2021 DExperts paper
  ☆118Updated 2 years ago
• Yale-LILY / dart
  Dataset for NAACL 2021 paper: "DART: Open-Domain Structured Data Record to Text Generation"
  ☆156Updated 3 years ago
• Yale-LILY / DYLE
  Repository for ACL'22 paper: Dynamic Latent Extraction for Abstractive Long-Input Summarization
  ☆56Updated 2 years ago
• xu1998hz / InstructScore_SEScore3
  First explanation metric (diagnostic report) for text generation evaluation
  ☆62Updated 10 months ago
• yangkevin2 / naacl-2021-fudge-controlled-generation
  ☆101Updated 3 years ago
• DevSinghSachan / art
  Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"
  ☆62Updated 3 years ago
• nyu-mll / crows-pairs
  This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…
  ☆127Updated last year