data-centric-ai / dcbenchLinks
A benchmark of data-centric tasks from across the machine learning lifecycle.
☆72Updated 3 years ago
Alternatives and similar repositories for dcbench
Users that are interested in dcbench are comparing it to the libraries listed below
Sorting:
- ☆139Updated last year
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆235Updated 3 years ago
- 🛠️ Corrected Test Sets for ImageNet, MNIST, CIFAR, Caltech-256, QuickDraw, IMDB, Amazon Reviews, 20News, and AudioSet☆185Updated 2 years ago
- Reduce end to end training time from days to hours (or hours to minutes), and energy requirements/costs by an order of magnitude using co…☆339Updated 2 years ago
- DISTIL: Deep dIverSified inTeractIve Learning. An active/inter-active learning library built on py-torch for reducing labeling costs.☆154Updated 2 years ago
- Measuring data importance over ML pipelines using the Shapley value.☆43Updated 3 months ago
- ☆95Updated 2 years ago
- Code for Active Learning at The ImageNet Scale. This repository implements many popular active learning algorithms and allows training wi…☆54Updated 3 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆97Updated 2 years ago
- This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.☆72Updated 2 years ago
- ☆89Updated 3 months ago
- Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling☆31Updated 4 years ago
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆151Updated 2 years ago
- ☆108Updated 2 years ago
- Code repository for our paper "Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift": https://arxiv.org/abs/1810.119…☆105Updated last year
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆83Updated 2 months ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆59Updated 2 years ago
- [NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark☆224Updated last year
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆36Updated 3 years ago
- ☆208Updated 2 years ago
- An active learning library for Pytorch based on Lightning-Fabric.☆79Updated last year
- Combating hidden stratification with GEORGE☆64Updated 4 years ago
- ☆96Updated 4 years ago
- Weakly Supervised End-to-End Learning (NeurIPS 2021)☆156Updated 2 years ago
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆41Updated 2 years ago
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- (ICML 2021) Mandoline: Model Evaluation under Distribution Shift☆30Updated 4 years ago
- ☆62Updated 4 years ago
- Code for "Supermasks in Superposition"☆124Updated last year
- ☆37Updated last year