deep-lab / DeepnetHessianLinks
Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)
☆16Updated 6 years ago
Alternatives and similar repositories for DeepnetHessian
Users that are interested in DeepnetHessian are comparing it to the libraries listed below
Sorting:
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆17Updated 6 years ago
- Code for the paper "Understanding Generalization through Visualizations"☆61Updated 4 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 3 years ago
- ☆59Updated 2 years ago
- ☆55Updated 5 years ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆41Updated last year
- Training vision models with full-batch gradient descent and regularization☆37Updated 2 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated 2 years ago
- ☆34Updated last year
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Updated 5 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 4 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆42Updated last year
- ☆34Updated 4 years ago
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 6 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 4 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 4 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆50Updated 4 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Official implementation for Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds (NeurIPS, 2021).☆24Updated 3 years ago
- NTK reading group☆87Updated 5 years ago
- PyTorch implementation of FIM and empirical FIM☆61Updated 7 years ago
- ☆16Updated 2 years ago
- Implementation of Invariant Risk Minimization https://arxiv.org/abs/1907.02893☆90Updated 5 years ago
- ☆124Updated last year
- Convolutional Neural Tangent Kernel☆113Updated 5 years ago
- ☆30Updated 4 years ago
- ☆62Updated 4 years ago
- ☆157Updated 3 years ago
- Code for the paper "Adversarial Neural Pruning with Latent Vulnerability Suppression"☆15Updated 2 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Updated 6 years ago