epfml / REQ
☆16Updated 7 months ago
Alternatives and similar repositories for REQ:
Users that are interested in REQ are comparing it to the libraries listed below
- SGD with large step sizes learns sparse features [ICML 2023]☆32Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- ☆15Updated last year
- Training vision models with full-batch gradient descent and regularization☆37Updated last year
- ☆63Updated last month
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆25Updated last year
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- ☆34Updated last year
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆20Updated last year
- Simple CIFAR10 ResNet example with JAX.☆22Updated 3 years ago
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆43Updated 3 years ago
- ☆10Updated 3 years ago
- ☆18Updated last year
- Latest Weight Averaging (NeurIPS HITY 2022)☆28Updated last year
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- ☆34Updated 2 years ago
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆35Updated last year
- CIFAR-5m dataset☆38Updated 4 years ago
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆21Updated 2 months ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Updated last year
- nanoGPT-like codebase for LLM training☆85Updated this week
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆9Updated 11 months ago
- A simple and efficient baseline for data attribution☆11Updated last year
- ☆35Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆48Updated 9 months ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆59Updated 4 months ago