facebookresearch / Pitfalls-of-MemorizationLinks
Understanding the interplay between memorization and generalization in neural networks, featuring MAT, a learning algorithm to enhance robustness by mitigating spurious correlations.
☆39Updated 8 months ago
Alternatives and similar repositories for Pitfalls-of-Memorization
Users that are interested in Pitfalls-of-Memorization are comparing it to the libraries listed below
Sorting:
- Data for "Datamodels: Predicting Predictions with Training Data"☆97Updated 2 years ago
- ☆19Updated 3 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago
- Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).☆59Updated 3 years ago
- A centralized place for deep thinking code and experiments☆86Updated 2 years ago
- ☆60Updated 3 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- ☆37Updated last year
- ☆133Updated 4 years ago
- Recycling diverse models☆45Updated 2 years ago
- Code for "Supermasks in Superposition"☆124Updated last year
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆40Updated 4 years ago
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆108Updated last year
- ☆46Updated 2 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆31Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated last year
- CIFAR10 ResNets implemented in JAX+Flax☆12Updated 3 years ago
- Pytorch library for factorized L0-based pruning.☆45Updated last year
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆151Updated 2 years ago
- [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks☆60Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆62Updated 4 years ago
- Parameter Efficient Transfer Learning with Diff Pruning☆74Updated 4 years ago
- The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…☆67Updated 2 years ago
- ☆34Updated 3 months ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 3 years ago
- ☆75Updated last year
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆72Updated last year
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated last year
- ☆45Updated last year