allenai / cartography
Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics
☆199Updated 2 years ago
Alternatives and similar repositories for cartography:
Users that are interested in cartography are comparing it to the libraries listed below
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆96Updated 2 years ago
- ☆84Updated last year
- ☆30Updated 3 years ago
- This repository accompanies our paper “Do Prompt-Based Models Really Understand the Meaning of Their Prompts?”☆85Updated 2 years ago
- This is a repository with the code for the EMNLP 2020 paper "Information-Theoretic Probing with Minimum Description Length"☆70Updated 8 months ago
- ☆96Updated 2 years ago
- Code and datasets for the EMNLP 2020 paper "Calibration of Pre-trained Transformers"☆59Updated last year
- Learning the Difference that Makes a Difference with Counterfactually-Augmented Data☆170Updated 3 years ago
- Uncertainty-aware Self-training☆121Updated last year
- ☆89Updated 2 years ago
- Heuristic Analysis for NLI Systems☆125Updated 4 years ago
- Hyperparameter Search for AllenNLP☆139Updated last month
- A library for parameter-efficient and composable transfer learning for NLP with sparse fine-tunings.☆71Updated 8 months ago
- code associated with ACL 2021 DExperts paper☆114Updated last year
- Code for the EMNLP 2021 Paper "Active Learning by Acquiring Contrastive Examples" & the ACL 2022 Paper "On the Importance of Effectively …☆125Updated 2 years ago
- ☆32Updated 10 months ago
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆82Updated last year
- OOD Generalization and Detection (ACL 2020)☆60Updated 5 years ago
- Implementation of Mixout with PyTorch☆75Updated 2 years ago
- Faithfulness and factuality annotations of XSum summaries from our paper "On Faithfulness and Factuality in Abstractive Summarization" (h…☆81Updated 4 years ago
- A Diagnostic Study of Explainability Techniques for Text Classification☆66Updated 4 years ago
- This repository contains the code for "Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP".☆88Updated 3 years ago
- Code for paper "CrossFit : A Few-shot Learning Challenge for Cross-task Generalization in NLP" (https://arxiv.org/abs/2104.08835)☆110Updated 2 years ago
- [EMNLP 2020] Collective HumAn OpinionS on Natural Language Inference Data☆36Updated 3 years ago
- [ICML 2021] Towards Understanding and Mitigating Social Biases in Language Models☆61Updated 2 years ago
- ☆63Updated 3 years ago
- "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)☆85Updated last year
- To analyze and remove gender bias in coreference resolution systems☆77Updated 3 years ago
- Data and code for our paper "Exploring and Predicting Transferability across NLP Tasks", to appear at EMNLP 2020.☆50Updated 4 years ago
- Automatic metrics for GEM tasks☆65Updated 2 years ago