JieyuZ2 / wrench
[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
☆224Updated last year
Alternatives and similar repositories for wrench:
Users that are interested in wrench are comparing it to the libraries listed below
- A curated list of programmatic weak supervision papers and resources☆190Updated 2 years ago
- ☆89Updated last year
- ☆96Updated 2 years ago
- Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics☆199Updated 2 years ago
- "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)☆85Updated last year
- ☆90Updated 2 years ago
- A benchmark of data-centric tasks from across the machine learning lifecycle.☆72Updated 2 years ago
- A fast, effective data attribution method for neural networks in PyTorch☆204Updated 5 months ago
- Influence Analysis and Estimation - Survey, Papers, and Taxonomy☆77Updated last year
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆71Updated last week
- A system for prompted weak supervision. Alfred is a powerful tool that leverages large language models to accelerate data annotation.☆52Updated 2 weeks ago
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆53Updated last year
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆150Updated 2 years ago
- Learning the Difference that Makes a Difference with Counterfactually-Augmented Data☆170Updated 3 years ago
- A python package for benchmarking interpretability techniques on Transformers.☆212Updated 6 months ago
- AI Logging for Interpretability and Explainability🔬☆111Updated 10 months ago
- Conformal Language Modeling☆28Updated last year
- A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.☆563Updated last year
- Code to reproduce data for Bias in Bios☆46Updated last year
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆83Updated last month
- A simple PyTorch implementation of influence functions.☆85Updated 10 months ago
- Official repository for CMU Machine Learning Department's 10732: Robustness and Adaptivity in Shifting Environments☆73Updated 2 years ago
- ☆32Updated 3 years ago
- ☆60Updated 3 years ago
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆96Updated 2 years ago
- Code for the paper "Causal Mediation Analysis for Interpreting Neural NLP: The Case of Gender Bias"☆75Updated 3 years ago
- tianlu-wang / Identifying-and-Mitigating-Spurious-Correlations-for-Improving-Robustness-in-NLP-ModelsNAACL 2022 Findings☆15Updated 2 years ago
- ACL 2022: An Empirical Survey of the Effectiveness of Debiasing Techniques for Pre-trained Language Models.☆137Updated 4 months ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆105Updated last year
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆82Updated last year