epfml / REQ
☆17Updated 9 months ago
Alternatives and similar repositories for REQ:
Users that are interested in REQ are comparing it to the libraries listed below
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- ☆16Updated last year
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- ☆65Updated 3 months ago
- SGD with large step sizes learns sparse features [ICML 2023]☆32Updated last year
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆21Updated 4 months ago
- Training vision models with full-batch gradient descent and regularization☆37Updated 2 years ago
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Updated last year
- ☆34Updated last year
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- ☆10Updated 3 years ago
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆44Updated 3 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 3 years ago
- ☆19Updated last year
- Blog post☆17Updated last year
- Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021☆27Updated 3 years ago
- [AAAI 2020 Oral] Low-variance Black-box Gradient Estimates for the Plackett-Luce Distribution☆37Updated 4 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆39Updated 4 years ago
- Latest Weight Averaging (NeurIPS HITY 2022)☆28Updated last year
- Code for "SAM as an Optimal Relaxation of Bayes", ICLR 2023.☆25Updated last year
- This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…☆35Updated 2 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆28Updated last year
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- CIFAR-5m dataset☆38Updated 4 years ago
- ☆57Updated 2 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆17Updated 5 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆79Updated last year
- ☆41Updated last year