MilaNLProc / honest
A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.
☆21Updated last month
Alternatives and similar repositories for honest
Users that are interested in honest are comparing it to the libraries listed below
Sorting:
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆82Updated last year
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 3 years ago
- Cross-lingual version of WEAT☆9Updated 6 years ago
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆61Updated 2 years ago
- Code for the paper "Measuring Bias in Contextualized Word Representations"☆35Updated 5 years ago
- ☆89Updated 2 years ago
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆27Updated 8 months ago
- StereoSet: Measuring stereotypical bias in pretrained language models☆181Updated 2 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆48Updated 2 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- A repository with several curated datasets of counter-narratives to fight online hate speech.☆89Updated last year
- ☆39Updated last year
- To analyze and remove gender bias in coreference resolution systems☆77Updated last week
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 3 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆136Updated 5 months ago
- Dataset + classifier tools to study social perception biases in natural language generation☆68Updated last year
- Code and Data for Evaluation WG☆41Updated 3 years ago
- ☆76Updated 3 years ago
- NAACL 2019 (Oral): Code for "Black is to Criminal as Caucasian is to Police: Detecting and Removing Multiclass Bias in Word Embeddings"☆40Updated 5 years ago
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆29Updated 3 years ago
- Code for the paper "Modeling Information Change in Science Communication with Semantically Matched Paraphrases" from EMNLP 2022☆13Updated 2 years ago
- Data for evaluating gender bias in coreference resolution systems.☆77Updated 6 years ago
- ☆52Updated last year
- A Python Commonsense Knowledge Inference Toolkit☆64Updated last year
- ☆25Updated 3 years ago
- ☆39Updated 5 years ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆10Updated this week
- ☆29Updated 2 years ago
- Framework for controlling demographic biases in NLG (using adversarial prompts)☆20Updated last year