MilaNLProc / honest
A Python package to compute HONEST, a score to measure hurtful sentence completions in language models. Published at NAACL 2021.
☆21Updated last week
Alternatives and similar repositories for honest:
Users that are interested in honest are comparing it to the libraries listed below
- ☆39Updated last year
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆28Updated 3 years ago
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆61Updated 2 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆48Updated 2 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆54Updated 3 years ago
- Dataset + classifier tools to study social perception biases in natural language generation☆67Updated last year
- Contrastive Fact Verification☆71Updated 2 years ago
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 3 years ago
- Data set for LREC 2020 paper "I Feel Offended, Don't Be Abusive!"☆18Updated last year
- Code and model checkpoints for the MultiVerS model for scientific claim verification.☆45Updated last year
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 2 years ago
- Cross-lingual version of WEAT☆9Updated 5 years ago
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆82Updated last year
- ☆96Updated last year
- Code for the paper "Modeling Information Change in Science Communication with Semantically Matched Paraphrases" from EMNLP 2022☆13Updated 2 years ago
- Official code release for ACL 2020 paper "Contextualizing Hate Speech Classifiers with Post hoc Explanation"☆35Updated 3 years ago
- ☆29Updated 2 years ago
- StereoSet: Measuring stereotypical bias in pretrained language models☆180Updated 2 years ago
- Framework for controlling demographic biases in NLG (using adversarial prompts)☆20Updated last year
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆178Updated last year
- Code and Data for Evaluation WG☆41Updated 2 years ago
- Code for the paper "Measuring Bias in Contextualized Word Representations"☆35Updated 5 years ago
- ☆75Updated 3 years ago
- Data for evaluating gender bias in coreference resolution systems.☆75Updated 5 years ago
- Collection of NLP model explanations and accompanying analysis tools☆145Updated last year
- ☆89Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 4 years ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆10Updated last month
- ☆96Updated 2 years ago