dxlong2000 / FormatBiasEvalLinks
Official codes for NAACL 2025 paper "LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs"
☆11Updated last month
Alternatives and similar repositories for FormatBiasEval
Users that are interested in FormatBiasEval are comparing it to the libraries listed below
Sorting:
- ☆15Updated 3 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆153Updated 4 months ago
- Codebase, data and models for the SummaC paper in TACL☆107Updated 11 months ago
- ☆20Updated last year
- The Dataset and Official Implementation for <Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understandi…☆18Updated last year
- ☆27Updated 3 years ago
- FRANK: Factuality Evaluation Benchmark☆59Updated 3 years ago
- Awesome LLM for NLG Evaluation Papers☆25Updated last year
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆36Updated last year
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆33Updated 9 months ago
- ☆71Updated last year
- ☆33Updated 3 weeks ago
- The implementation of "RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Question" [ACL 2023]☆16Updated last year
- [ACL 2023] S3HQA: A Three-Stage Approach for Multi-hop Text-Table Hybrid Question Answering☆20Updated 7 months ago
- This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…☆127Updated last year
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆21Updated 4 years ago
- ☆10Updated 2 years ago
- ☆62Updated 3 years ago
- This code accompanies the paper DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.☆16Updated 2 years ago
- Codes for ACL 2023 Paper "Fact-Checking Complex Claims with Program-Guided Reasoning"☆31Updated 2 years ago
- Dataset, metrics, and models for TACL 2023 paper MACSUM: Controllable Summarization with Mixed Attributes.☆34Updated 2 years ago
- Code and data for Marked Personas (ACL 2023)☆28Updated 2 years ago
- ACL 2023: Evaluating Open-Domain Question Answering in the Era of Large Language Models☆47Updated last year
- ☆19Updated 9 months ago
- ☆47Updated 3 months ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆56Updated 4 years ago
- Code and models for the paper "Questions Are All You Need to Train a Dense Passage Retriever (TACL 2023)"☆62Updated 3 years ago
- A comprehensive paper list of Reasoning over Tables.☆30Updated 3 years ago
- Code for ACL 2022 paper "Semi-Supervised Formality Style Transfer with Consistency Training".☆17Updated 3 years ago
- ☆17Updated 3 years ago