data-centric-ai / dcbenchLinks
A benchmark of data-centric tasks from across the machine learning lifecycle.
☆72Updated 3 years ago
Alternatives and similar repositories for dcbench
Users that are interested in dcbench are comparing it to the libraries listed below
Sorting:
- ☆139Updated last year
- 🛠️ Corrected Test Sets for ImageNet, MNIST, CIFAR, Caltech-256, QuickDraw, IMDB, Amazon Reviews, 20News, and AudioSet☆185Updated 2 years ago
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆83Updated 3 weeks ago
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆151Updated 2 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆97Updated 2 years ago
- ☆95Updated 2 years ago
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- Code for Active Learning at The ImageNet Scale. This repository implements many popular active learning algorithms and allows training wi…☆53Updated 3 years ago
- Implementation of Estimating Training Data Influence by Tracing Gradient Descent (NeurIPS 2020)☆233Updated 3 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆59Updated last year
- ☆89Updated 2 months ago
- DISTIL: Deep dIverSified inTeractIve Learning. An active/inter-active learning library built on py-torch for reducing labeling costs.☆152Updated 2 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆36Updated 3 years ago
- Code repository for our paper "Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift": https://arxiv.org/abs/1810.119…☆105Updated last year
- Combating hidden stratification with GEORGE☆63Updated 4 years ago
- ☆36Updated last year
- ☆108Updated 2 years ago
- This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.☆70Updated 2 years ago
- Code for "Supermasks in Superposition"☆124Updated last year
- Reduce end to end training time from days to hours (or hours to minutes), and energy requirements/costs by an order of magnitude using co…☆334Updated 2 years ago
- Interactive Weak Supervision: Learning Useful Heuristics for Data Labeling☆31Updated 4 years ago
- ☆208Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆41Updated 2 years ago
- ☆62Updated 4 years ago
- Active and Sample-Efficient Model Evaluation☆24Updated last month
- Measuring data importance over ML pipelines using the Shapley value.☆43Updated 2 months ago
- ☆96Updated 4 years ago
- [NeurIPS 2021] WRENCH: Weak supeRvision bENCHmark☆224Updated last year
- Weakly Supervised End-to-End Learning (NeurIPS 2021)☆157Updated 2 years ago