nyu-mll / crows-pairs
This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models" (EMNLP 2020).
☆102Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for crows-pairs
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆124Updated last year
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- Repository for the Bias Benchmark for QA dataset.☆84Updated 10 months ago
- ☆109Updated last year
- Codebase, data and models for the SummaC paper in TACL☆85Updated 10 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆65Updated 3 years ago
- Data for evaluating gender bias in coreference resolution systems.☆67Updated 5 years ago
- ☆61Updated 2 years ago
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆19Updated 3 years ago
- StereoSet: Measuring stereotypical bias in pretrained language models☆167Updated last year
- ☆38Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆61Updated last year
- ☆47Updated 6 months ago
- ☆25Updated 2 years ago
- ☆22Updated 8 months ago
- ☆41Updated last year
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 3 years ago
- ☆13Updated 2 years ago
- Framework for controlling demographic biases in NLG (using adversarial prompts)☆19Updated last year
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆21Updated this week
- code associated with ACL 2021 DExperts paper☆113Updated last year
- This repo contains the dataset for the EMNLP 2022 paper "Why Do You Feel This Way? Summarizing Triggers of Emotions in Social Media Posts…☆19Updated last year
- Dataset + classifier tools to study social perception biases in natural language generation☆66Updated last year
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆54Updated 10 months ago
- [ACL 2023] Knowledge Unlearning for Mitigating Privacy Risks in Language Models☆75Updated last month
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆86Updated 3 years ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆84Updated 2 years ago
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆60Updated 2 years ago
- ☆42Updated 9 months ago
- Code for Editing Factual Knowledge in Language Models☆135Updated 2 years ago