epfml / REQ
☆17Updated 10 months ago
Alternatives and similar repositories for REQ:
Users that are interested in REQ are comparing it to the libraries listed below
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- ☆67Updated 5 months ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- SGD with large step sizes learns sparse features [ICML 2023]☆32Updated 2 years ago
- Training vision models with full-batch gradient descent and regularization☆37Updated 2 years ago
- ☆16Updated 2 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆28Updated last year
- Simple CIFAR10 ResNet example with JAX.☆23Updated 3 years ago
- ☆18Updated last year
- ☆34Updated last year
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Updated last year
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆44Updated 4 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆30Updated last year
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆21Updated 6 months ago
- ☆10Updated 3 years ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆41Updated 2 years ago
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆31Updated 3 years ago
- Code for the paper "The Journey, Not the Destination: How Data Guides Diffusion Models"☆22Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆57Updated last month
- ☆58Updated 2 years ago
- ☆41Updated 2 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆36Updated 2 years ago
- ☆31Updated 4 years ago
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆47Updated last year
- ☆35Updated 2 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 9 months ago