facebookresearch / Pitfalls-of-MemorizationLinks
Understanding the interplay between memorization and generalization in neural networks, featuring MAT, a learning algorithm to enhance robustness by mitigating spurious correlations.
☆40Updated 11 months ago
Alternatives and similar repositories for Pitfalls-of-Memorization
Users that are interested in Pitfalls-of-Memorization are comparing it to the libraries listed below
Sorting:
- Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…☆106Updated 2 years ago
- ☆19Updated 3 years ago
- Data for "Datamodels: Predicting Predictions with Training Data"☆97Updated 2 years ago
- ☆63Updated 3 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆81Updated 2 years ago
- nanoGPT-like codebase for LLM training☆110Updated 2 weeks ago
- Code for "Supermasks in Superposition"☆124Updated 2 years ago
- Framework code with wandb, checkpointing, logging, configs, experimental protocols. Useful for fine-tuning models or training from scratc…☆152Updated 2 years ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆28Updated 3 weeks ago
- A centralized place for deep thinking code and experiments☆87Updated 2 years ago
- CIFAR10 ResNets implemented in JAX+Flax☆12Updated 3 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆41Updated 5 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago
- Code for "Training Neural Networks with Fixed Sparse Masks" (NeurIPS 2021).☆59Updated 3 years ago
- ☆79Updated 3 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆31Updated 2 years ago
- The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We…☆46Updated 2 years ago
- LLM finetuning in resource-constrained environments.☆53Updated last year
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆36Updated 3 years ago
- `dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.☆94Updated 2 weeks ago
- ☆37Updated 2 years ago
- ☆32Updated last year
- ☆55Updated 2 years ago
- Parameter Efficient Transfer Learning with Diff Pruning☆74Updated 4 years ago
- ☆45Updated 2 years ago
- NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers☆41Updated 9 months ago
- ☆241Updated last year
- ☆110Updated 9 months ago