bigabig / faithfulness
A library to evaluate factual correctness of abstractive summaries.
☆11Updated last year
Related projects ⓘ
Alternatives and complementary repositories for faithfulness
- Detect hallucinated tokens for conditional sequence generation.☆63Updated 2 years ago
- ☆17Updated last year
- ☆70Updated 3 years ago
- Code repo for SIGIR 2021 paper "Few-Shot Conversational Dense Retrieval"☆41Updated 2 years ago
- Official code repository for "Exploring Neural Models for Query-Focused Summarization".☆48Updated last year
- Code for NAACL 2021 full paper "Efficient Attentions for Long Document Summarization"☆64Updated 3 years ago
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆47Updated last year
- Code for ACL 2022 paper "Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptation"☆31Updated 2 years ago
- This is the code for the EMNLP2020 Finding paper "BERT for Monolingual and Cross-Lingual Reverse Dictionary"☆19Updated 4 years ago
- Mr. TyDi is a multi-lingual benchmark dataset built on TyDi, covering eleven typologically diverse languages.☆72Updated 2 years ago
- Research code for the paper "How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models"☆26Updated 3 years ago
- Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.☆34Updated last year
- ☆90Updated 8 months ago
- Official repository for our EACL 2023 paper "LongEval: Guidelines for Human Evaluation of Faithfulness in Long-form Summarization" (https…☆43Updated 3 months ago
- FrugalScore is an approach to learn a fixed, low cost version of any expensive NLG metric, while retaining most of its original performan…☆14Updated 2 years ago
- ☆57Updated 2 years ago
- ☆33Updated last year
- PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)☆38Updated 2 years ago
- Official implementation of the ACL Findings 2023 paper: Interpretable Automatic Fine-grained Inconsistency Detection in Text Summarizatio…☆13Updated 9 months ago
- Interpreting Language Models with Contrastive Explanations (EMNLP 2022 Best Paper Honorable Mention)☆58Updated 2 years ago
- ☆67Updated 3 years ago
- ☆44Updated last year
- Code for ACL 21: Generating Query Focused Summaries from Query-Free Resources☆33Updated 2 years ago
- ☆55Updated last year
- ☆14Updated 3 years ago
- Dense hybrid representations for text retrieval☆61Updated last year
- ☆35Updated last year
- Resources for paper "DialSummEval: Revisiting summarization evaluation for dialogues"☆14Updated last year
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆22Updated 7 months ago
- A Controllable Model of Grounded Response Generation (AAAI 21)☆13Updated 2 years ago