fKunstner / noise-sgd-adam-signLinks
☆16Updated 2 years ago
Alternatives and similar repositories for noise-sgd-adam-sign
Users that are interested in noise-sgd-adam-sign are comparing it to the libraries listed below
Sorting:
- Training vision models with full-batch gradient descent and regularization☆39Updated 2 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 4 years ago
- ☆28Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆36Updated 3 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated 2 years ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆41Updated 3 years ago
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 6 years ago
- SGD with large step sizes learns sparse features [ICML 2023]☆33Updated 2 years ago
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆48Updated 4 years ago
- ☆18Updated last year
- ☆34Updated last year
- ☆55Updated 5 years ago
- Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J☆71Updated last year
- ☆23Updated 3 years ago
- ☆58Updated 2 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆16Updated 6 years ago
- CIFAR-5m dataset☆39Updated 4 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 5 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 4 years ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.☆33Updated 2 years ago
- ☆110Updated 2 years ago
- ☆54Updated last year
- Last-layer Laplace approximation code examples☆83Updated 4 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆43Updated 2 years ago
- Code to implement the AND-mask and geometric mean to do gradient based optimization, from the paper "Learning explanations that are hard …☆41Updated 5 years ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆216Updated last week
- Supporting code for the paper "Dangers of Bayesian Model Averaging under Covariate Shift"☆33Updated 3 years ago
- ☆37Updated 2 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago