MilaNLProc / honest
A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.
☆21Updated 2 years ago
Alternatives and similar repositories for honest:
Users that are interested in honest are comparing it to the libraries listed below
- StereoSet: Measuring stereotypical bias in pretrained language models☆169Updated 2 years ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 2 years ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆87Updated 3 years ago
- ☆39Updated last year
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆78Updated 9 months ago
- Repository for research in the field of Responsible NLP at Meta.☆193Updated last month
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆60Updated 2 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆128Updated last month
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- To analyze and remove gender bias in coreference resolution systems☆76Updated 3 years ago
- ☆87Updated 2 years ago
- Dataset associated with "BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generation" paper☆70Updated 3 years ago
- Code to reproduce data for Bias in Bios☆43Updated last year
- ☆37Updated 5 years ago
- Cross-lingual version of WEAT☆9Updated 5 years ago
- Code and Data for Evaluation WG☆41Updated 2 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆47Updated 2 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆172Updated last year
- Code for the paper "Measuring Bias in Contextualized Word Representations"☆35Updated 5 years ago
- Learning Gender-Neutral Word Embeddings☆46Updated 5 years ago
- Framework for controlling demographic biases in NLG (using adversarial prompts)☆20Updated last year
- Dataset + classifier tools to study social perception biases in natural language generation☆67Updated last year
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆96Updated 2 years ago
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆27Updated 3 years ago
- code associated with ACL 2021 DExperts paper☆114Updated last year
- ☆25Updated 2 years ago
- A python package to run inference with HuggingFace language and vision-language checkpoints wrapping many convenient features.☆25Updated 4 months ago
- A repository with several curated datasets of counter-narratives to fight online hate speech.☆87Updated last year
- A Python Commonsense Knowledge Inference Toolkit☆63Updated last year
- [ACL 2020] Towards Debiasing Sentence Representations☆64Updated 2 years ago