Alternatives and similar repositories for qags

Users that are interested in qags are comparing it to the libraries listed below

• esdurmus / feqa

  View on GitHub
  Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)
  ☆48Jun 12, 2023Updated 2 years ago
• tagoyal / dae-factuality

  View on GitHub
  ☆28Nov 29, 2022Updated 3 years ago
• salesforce / factCC

  View on GitHub
  Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper
  ☆309May 1, 2025Updated 9 months ago
• mcao516 / Factual-Error-Correction

  View on GitHub
  ☆24May 26, 2022Updated 3 years ago
• OriShapira / LitePyramids

  View on GitHub
  Method for evaluating system summaries manually, via crowdsourcing, using a summarization dataset that includes reference summaries.
  ☆12May 5, 2019Updated 6 years ago
• neulab / REALSumm

  View on GitHub
  REALSumm: Re-evaluating Evaluation in Text Summarization
  ☆73Sep 22, 2025Updated 4 months ago
• artidoro / frank

  View on GitHub
  FRANK: Factuality Evaluation Benchmark
  ☆59Dec 13, 2022Updated 3 years ago
• google-research-datasets / xsum_hallucination_annotations

  View on GitHub
  Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…
  ☆84Nov 26, 2020Updated 5 years ago
• Yale-LILY / ROSE

  View on GitHub
  ☆39Jun 7, 2023Updated 2 years ago
• awslabs / unsupervised-qa

  View on GitHub
  Template-Based Question Generation from Retrieved Sentences for Improved Unsupervised Question Answering
  ☆57Jan 22, 2021Updated 5 years ago
• ThomasScialom / QuestEval

  View on GitHub
  ☆103Mar 4, 2024Updated last year
• Liyan06 / AggreFact

  View on GitHub
  Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)
  ☆28Mar 26, 2024Updated last year
• kite99520 / DialSummEval

  View on GitHub
  Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"
  ☆15Jul 22, 2025Updated 6 months ago
• jeongukjae / korean-wikipedia-corpus

  View on GitHub
  문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.
  ☆24Sep 6, 2023Updated 2 years ago
• tagoyal / factuality-datasets

  View on GitHub
  ☆46May 26, 2023Updated 2 years ago
• Yale-LILY / SummEval

  View on GitHub
  Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper
  ☆411Jun 23, 2024Updated last year
• luyang-huang96 / GraphAugmentedSum

  View on GitHub
  Knowledge Graph-Augmented Abstractive Summarization with Semantic-Driven Cloze Reward
  ☆76Sep 13, 2020Updated 5 years ago
• amazon-science / summary-reference-revision

  View on GitHub
  ☆19Apr 10, 2024Updated last year
• esdurmus / Wikilingua

  View on GitHub
  Multilingual abstractive summarization dataset extracted from WikiHow.
  ☆99Mar 14, 2025Updated 11 months ago
• martiansideofthemoon / longeval-summarization

  View on GitHub
  Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…
  ☆44Aug 10, 2024Updated last year
• SciMT / SciMT-benchmark

  View on GitHub
  ☆11Jan 3, 2024Updated 2 years ago
• mattf1n / basis-aware-threshold

  View on GitHub
  Code for the paper "Closing the Curious Case of Neural Text Degeneration"
  ☆11Apr 9, 2025Updated 10 months ago
• BinWang28 / FacEval

  View on GitHub
  EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization
  ☆13Mar 20, 2025Updated 10 months ago
• danieldeutsch / sacrerouge

  View on GitHub
  SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.
  ☆148Oct 22, 2022Updated 3 years ago
• yumoxu / querysum

  View on GitHub
  Code for EMNLP 20: Coarse-to-Fine Query Focused Multi-Document Summarization.
  ☆24Feb 9, 2021Updated 5 years ago
• kenchan0226 / dual_view_review_sum

  View on GitHub
  Code for the SIGIR 2020 paper "A Unified Dual-view Model for Review Summarization and Sentiment Classification with Inconsistency Loss"
  ☆21Feb 3, 2021Updated 5 years ago
• mswellhao / PacSum

  View on GitHub
  Unsupervised Extractive Summarization based on Position-Augmented Centrality
  ☆122Sep 6, 2021Updated 4 years ago
• swarnaHub / SummarizationPrograms

  View on GitHub
  [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees
  ☆24Jun 19, 2023Updated 2 years ago
• salesforce / QAFactEval

  View on GitHub
  ☆55Mar 27, 2023Updated 2 years ago
• Alex-Fabbri / Multi-News

  View on GitHub
  Large-scale multi-document summarization dataset and code
  ☆292May 8, 2023Updated 2 years ago
• jiacheng-xu / sum-interpret

  View on GitHub
  Code for Dissecting Generation Modes for Abstractive Summarization Models via Ablation and Attribution (ACL2021)
  ☆13Jun 2, 2021Updated 4 years ago
• bigheiniu / FactGen

  View on GitHub
  Fact Enhanced News Generation
  ☆12Jul 18, 2023Updated 2 years ago
• eunjiinkim / WellnessChatbot

  View on GitHub
  ☆10Jan 11, 2023Updated 3 years ago
• justincui03 / or-bench

  View on GitHub
  [ICML 2025] Official repository for paper "OR-Bench: An Over-Refusal Benchmark for Large Language Models"
  ☆21Mar 4, 2025Updated 11 months ago
• teddysum / Korean_SC_2023

  View on GitHub
  ☆10Oct 28, 2024Updated last year
• AIRC-KETI / Korean-Copora

  View on GitHub
  ☆14Dec 9, 2021Updated 4 years ago
• ChicagoHAI / decsum

  View on GitHub
  Implementation for Decision-focused Summarization (EMNLP2021)
  ☆12Mar 14, 2022Updated 3 years ago
• SeaEval / SeaEval

  View on GitHub
  NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning
  ☆26Mar 3, 2025Updated 11 months ago
• amazon-science / fact-check-summarization

  View on GitHub
  ☆78May 3, 2024Updated last year