deep-lab / DeepnetHessianLinks
Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)
☆16Updated 6 years ago
Alternatives and similar repositories for DeepnetHessian
Users that are interested in DeepnetHessian are comparing it to the libraries listed below
Sorting:
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆19Updated 6 years ago
- Code for the paper "Understanding Generalization through Visualizations"☆65Updated 4 years ago
- ☆59Updated 2 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆37Updated 3 years ago
- ☆56Updated 5 years ago
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Updated 5 years ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆42Updated last year
- ☆34Updated last year
- Training vision models with full-batch gradient descent and regularization☆39Updated 2 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated 2 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 5 years ago
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 7 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆43Updated 2 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 4 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆28Updated 4 years ago
- NTK reading group☆87Updated 6 years ago
- Implementation of Invariant Risk Minimization https://arxiv.org/abs/1907.02893☆91Updated 5 years ago
- Convolutional Neural Tangent Kernel☆112Updated 6 years ago
- ☆33Updated 4 years ago
- Lipschitz Neural Networks described in "Sorting Out Lipschitz Function Approximation" (ICML 2019).☆58Updated 5 years ago
- ☆62Updated 4 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Updated 6 years ago
- ☆30Updated 4 years ago
- PyTorch implementation of FIM and empirical FIM☆60Updated 7 years ago
- ☆158Updated 3 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆25Updated last year
- A way to achieve uniform confidence far away from the training data.☆38Updated 4 years ago
- ☆16Updated 2 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 4 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆50Updated 4 years ago