nyu-mll / crows-pairsLinks
This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models" (EMNLP 2020).
☆122Updated last year
Alternatives and similar repositories for crows-pairs
Users that are interested in crows-pairs are comparing it to the libraries listed below
Sorting:
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆143Updated 7 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆79Updated 4 years ago
- Repository for the Bias Benchmark for QA dataset.☆124Updated last year
- Codebase, data and models for the SummaC paper in TACL☆98Updated 6 months ago
- ☆141Updated last year
- StereoSet: Measuring stereotypical bias in pretrained language models☆186Updated 2 years ago
- Data for evaluating gender bias in coreference resolution systems.☆79Updated 6 years ago
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆31Updated 4 months ago
- ☆41Updated 2 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆56Updated 4 years ago
- Repository for research in the field of Responsible NLP at Meta.☆202Updated 2 months ago
- BARTScore: Evaluating Generated Text as Text Generation☆356Updated 3 years ago
- ☆13Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆66Updated 2 years ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆25Updated 4 months ago
- templates and other documents regarding responsible NLP research☆70Updated last year
- ☆23Updated 7 months ago
- ☆22Updated last year
- code associated with ACL 2021 DExperts paper☆115Updated 2 years ago
- ☆17Updated last month
- ☆27Updated 2 years ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- The geometry of multilingual language model representations (EMNLP 2022).☆21Updated 2 years ago
- FRANK: Factuality Evaluation Benchmark☆57Updated 2 years ago
- ☆216Updated 4 years ago
- ☆76Updated 7 months ago
- UnQovering Stereotyping Biases via Underspecified Questions - EMNLP 2020 (Findings)☆22Updated 4 years ago
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆366Updated 3 months ago
- This repo is for the paper: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark☆25Updated 2 years ago
- ACL2023 - AlignScore, a metric for factual consistency evaluation.☆135Updated last year