JieyuZ2 / wrench
[NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark
☆220Updated 9 months ago
Related projects ⓘ
Alternatives and complementary repositories for wrench
- A curated list of programmatic weak supervision papers and resources☆187Updated last year
- ☆86Updated last year
- "Understanding Dataset Difficulty with V-Usable Information" (ICML 2022, outstanding paper)☆82Updated last year
- ☆95Updated 2 years ago
- A fast, effective data attribution method for neural networks in PyTorch☆179Updated this week
- A benchmark of data-centric tasks from across the machine learning lifecycle.☆72Updated 2 years ago
- Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics☆192Updated 2 years ago
- ☆87Updated 2 years ago
- Learning the Difference that Makes a Difference with Counterfactually-Augmented Data☆168Updated 3 years ago
- Official repository for CMU Machine Learning Department's 10732: Robustness and Adaptivity in Shifting Environments☆73Updated last year
- Influence Analysis and Estimation - Survey, Papers, and Taxonomy☆63Updated 8 months ago
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆146Updated last year
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆95Updated last year
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆47Updated last year
- Conformal Language Modeling☆24Updated 10 months ago
- ☆149Updated 6 months ago
- Weakly Supervised End-to-End Learning (NeurIPS 2021)☆153Updated last year
- A benchmark for understanding and evaluating rationales: http://www.eraserbenchmark.com/☆97Updated 2 years ago
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆80Updated 3 weeks ago
- Distributionally robust neural networks for group shifts☆248Updated last year
- ☆37Updated 5 years ago
- Uncertainty-aware Self-training☆121Updated 11 months ago
- A system for prompted weak supervision. Alfred is a powerful tool that leverages large language models to accelerate data annotation.☆50Updated last month
- ☆32Updated 3 years ago
- A curated list of awesome datasets with human label variation (un-aggregated labels) in Natural Language Processing and Computer Vision, …☆76Updated 7 months ago
- A machine learning benchmark of in-the-wild distribution shifts, with data loaders, evaluators, and default models.☆551Updated 9 months ago
- Fairness toolkit for pytorch, scikit learn and autogluon☆21Updated 2 weeks ago
- Summarize Massive Datasets using Submodular Optimization☆87Updated 2 months ago
- ☆58Updated 2 years ago
- A Python library that encapsulates various methods for neuron interpretation and analysis in Deep NLP models.☆97Updated last year