mainlp / awesome-human-label-variationLinks
A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, accompanying The 'Problem' of Human Label Variation: On Ground Truth in Data, Modeling and Evaluation (EMNLP 2022)
☆93Updated last year
Alternatives and similar repositories for awesome-human-label-variation
Users that are interested in awesome-human-label-variation are comparing it to the libraries listed below
Sorting:
- How Contextual are Contextualized Word Representations?☆42Updated 5 years ago
- ☆97Updated 3 years ago
- Data for evaluating gender bias in coreference resolution systems.☆81Updated 6 years ago
- To analyze and remove gender bias in coreference resolution systems☆79Updated 6 months ago
- Materials for the EMNLP 2020 Tutorial on "Interpreting Predictions of NLP Models"☆200Updated 4 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆98Updated 3 years ago
- ☆39Updated 4 years ago
- ☆40Updated 6 years ago
- A Large-Scale Gender Bias Dataset for Coreference Resolution and Machine Translation, Levy et al., Findings of EMNLP 2021☆14Updated 3 years ago
- This repository provides details and links to the ACL anthology corpus/collection including .bib, .pdf and grobid extractions of the pdfs☆184Updated 2 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆106Updated 2 years ago
- ☆101Updated last year
- ☆41Updated 2 years ago
- Code and test data for "On Measuring Bias in Sentence Encoders", to appear at NAACL 2019.☆56Updated 4 years ago
- Diagnostic tests for linguistic capacities in language models☆65Updated 3 years ago
- Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics☆205Updated 3 years ago
- A Diagnostic Study of Explainability Techniques for Text Classification☆68Updated 5 years ago
- A repository with several curated datasets of counter-narratives to fight online hate speech.☆93Updated 3 months ago
- Dataset + classifier tools to study social perception biases in natural language generation☆70Updated 2 years ago
- ☆90Updated 3 years ago
- Find informative examples to efficiently (human)-evaluate NLG models.☆16Updated last month
- Code for our WOAH@ACL 2021 Paper on Data Integration for Toxic Comment Classification: Making More Than 40 Datasets Easily Accessible in …☆29Updated 3 years ago
- Code associated with the paper "Entropy-based Attention Regularization Frees Unintended Bias Mitigation from Lists"☆50Updated 3 years ago
- Replication code for "With Little Power Comes Great Responsibility"☆39Updated 5 years ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 3 years ago
- Learning Gender-Neutral Word Embeddings☆47Updated 6 years ago
- Workshop Home Page for Benchmarking: Past, Present and Future☆35Updated 4 years ago
- Official code release for ACL 2020 paper "Contextualizing Hate Speech Classifiers with Post hoc Explanation"☆35Updated 3 years ago
- ☆53Updated last year
- SacreROUGE is a library dedicated to the use and development of text generation evaluation metrics with an emphasis on summarization.☆146Updated 3 years ago