socialfoundations / benchbenchLinks
BenchBench is a Python package to evaluate multi-task benchmarks.
☆17Updated 2 months ago
Alternatives and similar repositories for benchbench
Users that are interested in benchbench are comparing it to the libraries listed below
Sorting:
- ModelDiff: A Framework for Comparing Learning Algorithms☆58Updated 2 years ago
- ☆37Updated 2 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆97Updated 2 years ago
- Model Patching: Closing the Subgroup Performance Gap with Data Augmentation☆42Updated 5 years ago
- ☆34Updated 6 months ago
- ☆96Updated 3 years ago
- ☆46Updated 2 years ago
- DiWA: Diverse Weight Averaging for Out-of-Distribution Generalization☆31Updated 2 years ago
- Code and results accompanying our paper titled RLSbench: Domain Adaptation under Relaxed Label Shift☆35Updated 2 years ago
- Code for the CVPR 2021 paper: Understanding Failures of Deep Networks via Robust Feature Extraction☆36Updated 3 years ago
- Fast Axiomatic Attribution for Neural Networks (NeurIPS*2021)☆16Updated 2 years ago
- ☆110Updated 3 years ago
- Recycling diverse models☆46Updated 2 years ago
- Code accompanying paper: Meta-Learning to Improve Pre-Training☆37Updated 4 years ago
- ☆18Updated 3 years ago
- ☆19Updated 3 years ago
- Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning (AISTATS 2022 Oral)☆42Updated 3 years ago
- Distilling Model Failures as Directions in Latent Space☆47Updated 2 years ago
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆152Updated 2 years ago
- This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.☆72Updated 2 years ago
- Code for paper "Can contrastive learning avoid shortcut solutions?" NeurIPS 2021.☆47Updated 3 years ago
- Fine-grained ImageNet annotations☆30Updated 5 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 3 years ago
- PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures (CVPR 2022)☆109Updated 3 years ago
- Code for "Supermasks in Superposition"☆124Updated 2 years ago
- ☆55Updated 5 years ago
- ☆37Updated 3 years ago
- This repository contains the code of the distribution shift framework presented in A Fine-Grained Analysis on Distribution Shift (Wiles e…☆84Updated last week
- Active and Sample-Efficient Model Evaluation☆26Updated 6 months ago