socialfoundations / benchbench
BenchBench is a Python package to evaluate multi-task benchmarks.
☆13Updated 6 months ago
Alternatives and similar repositories for benchbench:
Users that are interested in benchbench are comparing it to the libraries listed below
- ModelDiff: A Framework for Comparing Learning Algorithms☆54Updated last year
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆34Updated last year
- ☆24Updated 3 years ago
- ☆43Updated 2 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆94Updated last year
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- ☆11Updated last year
- ☆17Updated 2 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆28Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- ☆34Updated 5 months ago
- ☆35Updated last year
- ☆58Updated 3 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆19Updated 3 years ago
- Spurious Features Everywhere - Large-Scale Detection of Harmful Spurious Features in ImageNet☆29Updated last year
- Do input gradients highlight discriminative features? [NeurIPS 2021] (https://arxiv.org/abs/2102.12781)☆13Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- ☆107Updated last year
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆41Updated last year
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- ☆28Updated last year
- Conformal prediction for controlling monotonic risk functions. Simple accompanying PyTorch code for conformal risk control in computer vi…☆60Updated last year
- Code for the ICLR 2022 paper. Salient Imagenet: How to discover spurious features in deep learning?☆36Updated 2 years ago
- Simple and scalable tools for data-driven pretraining data selection.☆14Updated last week
- ☆108Updated 2 years ago
- Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"☆15Updated 2 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆34Updated last year
- ☆40Updated 2 years ago
- ☆34Updated 3 years ago
- Improving Transformation Invariance in Contrastive Representation Learning☆13Updated 3 years ago