mainlp / awesome-human-label-variationLinks
A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, accompanying The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation (EMNLP 2022)
☆92Updated last year
Alternatives and similar repositories for awesome-human-label-variation
Users that are interested in awesome-human-label-variation are comparing it to the libraries listed below
Sorting:
- ☆39Updated 4 years ago
- To analyze and remove gender bias in coreference resolution systems☆79Updated 3 months ago
- How Contextual are Contextualized Word Representations?☆41Updated 5 years ago
- ☆97Updated 3 years ago
- Data for evaluating gender bias in coreference resolution systems.☆80Updated 6 years ago
- ☆41Updated 2 years ago
- ☆89Updated 3 years ago
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆29Updated 3 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆183Updated last year
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆97Updated 2 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆103Updated last year
- ☆31Updated last year
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆49Updated 3 years ago
- Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"☆199Updated 4 years ago
- Data and code for our paper "Exploring and Predicting Transferability across NLP Tasks", to appear at EMNLP 2020.☆50Updated 4 years ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 3 years ago
- Official code release for ACL 2020 paper "Contextualizing Hate Speech Classifiers with Post hoc Explanation"☆35Updated 3 years ago
- Diagnostic tests for linguistic capacities in language models☆66Updated 3 years ago
- ☆100Updated last year
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆61Updated 2 years ago
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆144Updated 2 years ago
- Code for the EMNLP 2021 Paper "Active Learning by Acquiring Contrastive Examples" & the ACL 2022 Paper "On the Importance of Effectively …☆126Updated 3 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆56Updated 4 years ago
- A Diagnostic Study of Explainability Techniques for Text Classification☆68Updated 4 years ago
- Framework for controlling demographic biases in NLG (using adversarial prompts)☆20Updated 2 years ago
- Code for the paper "Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias"☆80Updated 4 years ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆15Updated last week
- Utility for behavioral and representational analyses of Language Models☆158Updated 2 weeks ago
- Collection of NLP model explanations and accompanying analysis tools☆144Updated 2 years ago
- [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data☆38Updated 3 years ago