nyu-mll / crows-pairsLinks
This repository contains the data and code introduced in the paper "CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models" (EMNLP 2020).
☆122Updated last year
Alternatives and similar repositories for crows-pairs
Users that are interested in crows-pairs are comparing it to the libraries listed below
Sorting:
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆139Updated 6 months ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆79Updated 4 years ago
- Codebase, data and models for the SummaC paper in TACL☆97Updated 5 months ago
- Repository for the Bias Benchmark for QA dataset.☆123Updated last year
- ☆137Updated last year
- StereoSet: Measuring stereotypical bias in pretrained language models☆184Updated 2 years ago
- Data and info for the paper "ParaDetox: Text Detoxification with Parallel Data"☆31Updated 3 months ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- Data for evaluating gender bias in coreference resolution systems.☆79Updated 6 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆56Updated 4 years ago
- Can Large Language Models Be an Alternative to Human Evaluations?☆9Updated last year
- ☆23Updated 7 months ago
- ☆40Updated 2 years ago
- Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper he…☆25Updated 4 months ago
- ☆26Updated 2 years ago
- ☆17Updated 3 weeks ago
- Github repository for "FELM: Benchmarking Factuality Evaluation of Large Language Models" (NeurIPS 2023)☆59Updated last year
- code associated with ACL 2021 DExperts paper☆115Updated 2 years ago
- ☆60Updated 7 months ago
- ☆15Updated 2 years ago
- Repository for research in the field of Responsible NLP at Meta.☆200Updated 2 months ago
- Token-level Reference-free Hallucination Detection☆94Updated last year
- BARTScore: Evaluating Generated Text as Text Generation☆352Updated 3 years ago
- ☆22Updated last year
- ☆13Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆66Updated 2 years ago
- ☆51Updated 2 years ago
- Repo for paper: Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge☆14Updated last year
- templates and other documents regarding responsible NLP research☆69Updated last year
- This repo is for the paper: On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmark☆25Updated 2 years ago