socialfoundations / benchbench
BenchBench is a Python package to evaluate multi-task benchmarks.
☆12Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for benchbench
- Data for "Datamodels: Predicting Predictions with Training Data"☆90Updated last year
- ☆24Updated 3 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Updated last year
- ☆22Updated last year
- ☆34Updated 3 months ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Spurious Features Everywhere - Large-Scale Detection of Harmful Spurious Features in ImageNet☆29Updated last year
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆15Updated 2 years ago
- ☆105Updated last year
- LISA for ICML 2022☆47Updated last year
- ☆41Updated last year
- ☆55Updated 4 years ago
- Personal implementation of ASIF by Antonio Norelli☆24Updated 5 months ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆40Updated last year
- ModelDiff: A Framework for Comparing Learning Algorithms☆53Updated last year
- ☆58Updated 2 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆34Updated last year
- Distilling Model Failures as Directions in Latent Space☆45Updated last year
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- ☆17Updated 2 years ago
- ☆13Updated 8 months ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated last year
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆67Updated 6 months ago
- ☆35Updated last year
- Code for the paper "A Whac-A-Mole Dilemma Shortcuts Come in Multiples Where Mitigating One Amplifies Others"☆44Updated 4 months ago
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 3 years ago
- Do input gradients highlight discriminative features? [NeurIPS 2021] (https://arxiv.org/abs/2102.12781)☆13Updated last year
- [NeurIPS'22] Official Repository for Characterizing Datapoints via Second-Split Forgetting☆14Updated last year
- Latest Weight Averaging (NeurIPS HITY 2022)☆20Updated last year