Alternatives and similar repositories for QuestEval

Users that are interested in QuestEval are comparing it to the libraries listed below

• salesforce / QAFactEval

  View on GitHub
  ☆55Mar 27, 2023Updated 2 years ago
• xieyxclack / factual_coco

  View on GitHub
  The implementation of <Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation> in PyTorch.
  ☆17Nov 11, 2021Updated 4 years ago
• Liyan06 / AggreFact

  View on GitHub
  Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
  ☆28Mar 26, 2024Updated last year
• Huffon / factsumm

  View on GitHub
  FactSumm: Factual Consistency Scorer for Abstractive Summarization
  ☆113Jan 1, 2024Updated 2 years ago
• danieldeutsch / qaeval

  View on GitHub
  ☆15Aug 3, 2021Updated 4 years ago
• kite99520 / DialSummEval

  View on GitHub
  Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"
  ☆15Jul 22, 2025Updated 6 months ago
• google-research-datasets / xsum_hallucination_annotations

  View on GitHub
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Nov 26, 2020Updated 5 years ago
• neulab / BARTScore

  View on GitHub
  BARTScore: Evaluating Generated Text as Text Generation
  ☆367Jun 27, 2022Updated 3 years ago
• danieldeutsch / sacrerouge

  View on GitHub
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆148Oct 22, 2022Updated 3 years ago
• artidoro / frank

  View on GitHub
  FRANK: Factuality Evaluation Benchmark
  ☆59Dec 13, 2022Updated 3 years ago
• potamides / unsupervised-metrics

  View on GitHub
  Library for experimenting with state-of-the-art evaluation metrics like UScore
  ☆12May 27, 2023Updated 2 years ago
• PrimerAI / blanc

  View on GitHub
  Human-free quality estimation of document summaries
  ☆97Dec 1, 2025Updated 2 months ago
• ShuyangCao / cliff_summ

  View on GitHub
  Code for EMNLP 2021 paper "CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization"
  ☆46Jan 17, 2022Updated 4 years ago
• tagoyal / dae-factuality

  View on GitHub
  ☆28Nov 29, 2022Updated 3 years ago
• meetdavidwan / factpegasus

  View on GitHub
  PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)
  ☆40Sep 15, 2022Updated 3 years ago
• hwanheelee1993 / ViLBERTScore

  View on GitHub
  Code for ViLBERTScore in EMNLP Eval4NLP
  ☆18Oct 27, 2022Updated 3 years ago
• Yale-LILY / SummEval

  View on GitHub
  Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper
  ☆411Jun 23, 2024Updated last year
• malihealikhani / Cross-modal_Coherence_Modeling

  View on GitHub
  Cross-modal Coherence Modeling for Caption Generation
  ☆11Jul 24, 2020Updated 5 years ago
• Alex-Fabbri / AnswerSumm

  View on GitHub
  ☆10Jul 18, 2022Updated 3 years ago
• Yale-LILY / ConvoSumm

  View on GitHub
  ☆39Jan 9, 2023Updated 3 years ago
• tanyuqian / ctc-gen-eval

  View on GitHub
  EMNLP 2021 - CTC: A Unified Framework for Evaluating Natural Language Generation
  ☆97Mar 20, 2023Updated 2 years ago
• akashkm99 / duelnlg

  View on GitHub
  Code for ACL 2022 Paper: Active Evaluation: Efficient NLG Evaluation with Few Pairwise Comparisons
  ☆14Dec 22, 2022Updated 3 years ago
• Yale-LILY / QMSum

  View on GitHub
  Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"
  ☆142Aug 29, 2023Updated 2 years ago
• Wendy-Xiao / redundancy_reduction_longdoc

  View on GitHub
  This is the official code for the paper 'Systematically Exploring Redundancy Reduction inSummarizing Long Documents'.
  ☆16Apr 30, 2021Updated 4 years ago
• VanderpoelLiam / CPMI

  View on GitHub
  Mutual Information Predicts Hallucinations in Abstractive Summarization
  ☆13Nov 14, 2022Updated 3 years ago
• martiansideofthemoon / longeval-summarization

  View on GitHub
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Aug 10, 2024Updated last year
• violet-zct / fairseq-detect-hallucination

  View on GitHub
  Detect hallucinated tokens for conditional sequence generation.
  ☆64Apr 15, 2022Updated 3 years ago
• tagoyal / factuality-datasets

  View on GitHub
  ☆46May 26, 2023Updated 2 years ago
• Chen-Wang-CUHK / Training-Free-and-Ref-Free-Summ-Evaluation

  View on GitHub
  The source code of our ACL paper "A Training-free and Reference-free Summarization Evaluation Metric via Centrality-weighted Relevance an…
  ☆14May 6, 2023Updated 2 years ago
• yixinL7 / Refactoring-Summarization

  View on GitHub
  ☆18Apr 11, 2021Updated 4 years ago
• AIPHES / emnlp19-moverscore

  View on GitHub
  MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distance
  ☆210Nov 20, 2023Updated 2 years ago
• orhonovich / q-squared

  View on GitHub
  ☆30Sep 5, 2021Updated 4 years ago
• esdurmus / Wikilingua

  View on GitHub
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆99Mar 14, 2025Updated 11 months ago
• neulab / REALSumm

  View on GitHub
  REALSumm: Re-evaluating Evaluation in Text Summarization
  ☆73Sep 22, 2025Updated 4 months ago
• amazon-science / fact-graph

  View on GitHub
  Implementation of the paper "FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations (NAACL 2022)"
  ☆50Jul 26, 2023Updated 2 years ago
• McGill-NLP / MLQuestions

  View on GitHub
  ☆19Apr 5, 2022Updated 3 years ago
• diyiy / Wiki_Semantic_Intention

  View on GitHub
  Predict edit intentions on Wikipedia
  ☆19Jan 24, 2019Updated 7 years ago
• AI21Labs / factor

  View on GitHub
  Code and data for the FACTOR paper
  ☆54Nov 15, 2023Updated 2 years ago
• psunlpgroup / MACSum

  View on GitHub
  Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.
  ☆34Jul 25, 2023Updated 2 years ago