nyu-mll / crows-pairs
This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models" (EMNLP 2020).
☆118Updated last year
Alternatives and similar repositories for crows-pairs:
Users that are interested in crows-pairs are comparing it to the libraries listed below
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆137Updated 4 months ago
- Repository for the Bias Benchmark for QA dataset.☆114Updated last year
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆80Updated 4 years ago
- ☆131Updated last year
- Codebase, data and models for the SummaC paper in TACL☆93Updated 3 months ago
- Data for evaluating gender bias in coreference resolution systems.☆77Updated 5 years ago
- StereoSet: Measuring stereotypical bias in pretrained language models☆181Updated 2 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- Can Large Language Models Be an Alternative to Human Evaluations?☆9Updated last year
- ☆26Updated last year
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆22Updated 3 years ago
- Code and data for Marked Personas (ACL 2023)☆24Updated last year
- ☆39Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆65Updated 2 years ago
- Repository for research in the field of Responsible NLP at Meta.☆199Updated 5 months ago
- code associated with ACL 2021 DExperts paper☆114Updated last year
- ☆174Updated 2 years ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆23Updated last month
- ☆15Updated 2 years ago
- An Apache 2.0 fork of HuggingFace's Large Language Model Text Generation Inference☆20Updated last year
- Code for Editing Factual Knowledge in Language Models☆137Updated 3 years ago
- ☆13Updated last year
- ☆57Updated 5 months ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆82Updated 4 years ago
- ☆30Updated 3 years ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆59Updated last year
- ☆174Updated 9 months ago
- ☆106Updated last year
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆30Updated last month