socialfoundations / benchbench
BenchBench is a Python package to evaluate multi-task benchmarks.
☆15Updated 9 months ago
Alternatives and similar repositories for benchbench
Users that are interested in benchbench are comparing it to the libraries listed below
Sorting:
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆30Updated 2 years ago
- ☆17Updated 2 years ago
- Recycling diverse models☆44Updated 2 years ago
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆16Updated 2 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆30Updated last year
- ModelDiff: A Framework for Comparing Learning Algorithms☆56Updated last year
- ☆35Updated last year
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆34Updated last year
- Do input gradients highlight discriminative features? [NeurIPS 2021] (https://arxiv.org/abs/2102.12781)☆13Updated 2 years ago
- The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …☆16Updated last year
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 4 years ago
- Official code for the paper: "Metadata Archaeology"☆19Updated 2 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- ☆37Updated 9 months ago
- ☆26Updated 2 years ago
- ☆45Updated 2 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆36Updated 2 years ago
- Code for NeurIPS'23 paper "A Bayesian Approach To Analysing Training Data Attribution In Deep Learning"☆17Updated last year
- ☆38Updated 3 years ago
- Post-processing for fair classification☆13Updated last month
- ☆24Updated 4 years ago
- Implementation for our paper "How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad"☆12Updated 11 months ago
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 4 years ago
- Pytorch implementation for "The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstruction"☆33Updated 2 years ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated last year
- Source code of "Hold me tight! Influence of discriminative features on deep network boundaries"☆22Updated 3 years ago
- ☆24Updated 3 months ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆37Updated 2 years ago
- LISA for ICML 2022☆49Updated 2 years ago
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆83Updated 2 months ago