nyu-mll / BBQ
Repository for the Bias Benchmark for QA dataset.
☆102Updated last year
Alternatives and similar repositories for BBQ:
Users that are interested in BBQ are comparing it to the libraries listed below
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆71Updated 4 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆133Updated 2 months ago
- ☆127Updated last year
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆20Updated 3 years ago
- This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Maske…☆112Updated last year
- ☆47Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆58Updated last year
- Data for evaluating gender bias in coreference resolution systems.☆72Updated 5 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆13Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆64Updated 2 years ago
- ☆75Updated last year
- Code and data for Marked Personas (ACL 2023)☆22Updated last year
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆87Updated 3 years ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- ☆103Updated 10 months ago
- EMNLP 2022: "MABEL: Attenuating Gender Bias using Textual Entailment Data" https://arxiv.org/abs/2210.14975☆37Updated last year
- ☆53Updated 3 months ago
- ☆72Updated last year
- ☆25Updated last year
- Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".☆75Updated 3 months ago
- Codebase, data and models for the SummaC paper in TACL☆87Updated last month
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆29Updated 4 months ago
- Text generation using language models with multiple exit heads☆15Updated 3 weeks ago
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆60Updated 2 years ago
- Röttger et al. (NAACL 2024): "XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Models"☆85Updated last week
- ☆40Updated 10 months ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- ☆25Updated 5 months ago
- An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).☆49Updated 6 months ago