socialfoundations / benchbench
BenchBench is a Python package to evaluate multi-task benchmarks.
☆13Updated 7 months ago
Alternatives and similar repositories for benchbench:
Users that are interested in benchbench are comparing it to the libraries listed below
- Do input gradients highlight discriminative features? [NeurIPS 2021] (https://arxiv.org/abs/2102.12781)☆13Updated 2 years ago
- ModelDiff: A Framework for Comparing Learning Algorithms☆55Updated last year
- ☆24Updated 3 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆95Updated last year
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆34Updated last year
- Post-processing for fair classification☆13Updated last month
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆82Updated 3 months ago
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆15Updated 2 years ago
- ☆28Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Distilling Model Failures as Directions in Latent Space☆46Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- ☆60Updated 3 years ago
- ☆35Updated last year
- ☆44Updated 2 years ago
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Updated 4 years ago
- ☆26Updated 11 months ago
- ☆17Updated 2 years ago
- Achieve error-rate fairness between societal groups for any score-based classifier.☆16Updated 9 months ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆28Updated last year
- ☆34Updated 6 months ago
- LISA for ICML 2022☆47Updated last year
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"☆48Updated 8 months ago
- Code for the ICLR 2021 Paper "In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustness"☆12Updated 3 years ago
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆51Updated last year
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- Code for the ICLR 2022 paper. Salient Imagenet: How to discover spurious features in deep learning?☆38Updated 2 years ago
- This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.☆71Updated 2 years ago