FRANK: Factuality Evaluation Benchmark
☆59Dec 13, 2022Updated 3 years ago
Alternatives and similar repositories for frank
Users that are interested in frank are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆46May 26, 2023Updated 3 years ago
- Resources for the "Evaluating the Factual Consistency of Abstractive Text Summarization" paper☆307May 1, 2025Updated last year
- ☆27Nov 29, 2022Updated 3 years ago
- Codebase, data and models for the SummaC paper in TACL☆109Jan 30, 2025Updated last year
- Data and code for "A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarization" (ACL 2020)☆48Jun 12, 2023Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆14Aug 30, 2023Updated 2 years ago
- Factual consistency checking model for abstractive summaries (NAACL-22 Findings)☆30May 7, 2022Updated 4 years ago
- ☆40Jun 7, 2023Updated 3 years ago
- Understanding Factual Errors in Summarization: Errors, Summarizers, Datasets, Error Detectors (ACL 2023)☆28Mar 26, 2024Updated 2 years ago
- Implementation of the paper "FactGraph: Evaluating Factuality in Summarization with Semantic Graph Representations (NAACL 2022)"☆52Jul 26, 2023Updated 2 years ago
- Question Answering and Generation for Summarization☆72Nov 27, 2022Updated 3 years ago
- Detect hallucinated tokens for conditional sequence generation.☆64Apr 15, 2022Updated 4 years ago
- ☆27Nov 6, 2022Updated 3 years ago
- PyTorch code for "FactPEGASUS: Factuality-Aware Pre-training and Fine-tuning for Abstractive Summarization" (NAACL 2022)☆40Sep 15, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Aug 3, 2021Updated 4 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆84Nov 26, 2020Updated 5 years ago
- ☆105Mar 4, 2024Updated 2 years ago
- This repository provides the source code used to automatically generate the book summarization datasets described in the paper titled "Ec…☆10Apr 14, 2025Updated last year
- ☆18May 5, 2021Updated 5 years ago
- ☆24May 26, 2022Updated 4 years ago
- ☆10May 26, 2022Updated 4 years ago
- Extended Wikilinks dataset description☆15Apr 1, 2018Updated 8 years ago
- Simple Conversational Data Augmentation for Semi-supervised Abstractive Conversation Summarization☆10Mar 7, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- LUNA: a Framework for Language Understanding and Naturalness Assessment.☆12Sep 9, 2023Updated 2 years ago
- Source codes for "Structure-Aware Abstractive Conversation Summarization via Discourse and Action Graphs"☆65Oct 27, 2023Updated 2 years ago
- Source codes for the paper "Multi-View Sequence-to-Sequence Models with Conversational Structure for Abstractive Dialogue Summarization"☆91Oct 27, 2023Updated 2 years ago
- Code for "FactKB: Generalizable Factuality Evaluation using Language Models Enhanced with Factual Knowledge". EMNLP 2023.☆20Dec 25, 2023Updated 2 years ago
- Code for EMNLP 2021 paper "CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization"☆47Jan 17, 2022Updated 4 years ago
- Codes for NAACL 2021 paper 'Noisy Self-Knowledge Distillation for Text Summarization'☆24Jul 27, 2021Updated 4 years ago
- GSum: A General Framework for Guided Neural Abstractive Summarization☆115Sep 22, 2025Updated 8 months ago
- Masking tokens to modify the predictions of a pretrained sentence classifier☆16Feb 4, 2020Updated 6 years ago
- Summarization Papers☆1,008Jul 15, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Dataset for NAACL 2021 paper: "QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarization"☆151Aug 29, 2023Updated 2 years ago
- This repository contains the dataset and code for "WiCE: Real-World Entailment for Claims in Wikipedia" in EMNLP 2023.☆42Dec 15, 2023Updated 2 years ago
- Resources for the "SummEval: Re-evaluating Summarization Evaluation" paper☆415Jun 23, 2024Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆369Jun 27, 2022Updated 3 years ago
- This repository contains the source code and links to some datasets used in the CoNLL 2019 paper "Learning to Represent Bilingual Diction…☆12Oct 1, 2020Updated 5 years ago
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated last year
- [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees☆23Jun 19, 2023Updated 2 years ago