deep-lab / DeepnetHessianLinks
Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)
☆16Updated 6 years ago
Alternatives and similar repositories for DeepnetHessian
Users that are interested in DeepnetHessian are comparing it to the libraries listed below
Sorting:
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆17Updated 6 years ago
- ☆59Updated 2 years ago
- Code for the paper "Understanding Generalization through Visualizations"☆64Updated 4 years ago
- ☆34Updated last year
- ☆55Updated 5 years ago
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Updated 5 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆36Updated 3 years ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆42Updated last year
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated 2 years ago
- Training vision models with full-batch gradient descent and regularization☆39Updated 2 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆28Updated 4 years ago
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 6 years ago
- ☆16Updated 2 years ago
- PyTorch implementation of FIM and empirical FIM☆60Updated 7 years ago
- ☆62Updated 4 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆50Updated 4 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 4 years ago
- Official implementation for Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds (NeurIPS, 2021).☆24Updated 3 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 5 years ago
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆43Updated 2 years ago
- Coresets via Bilevel Optimization☆67Updated 5 years ago
- NTK reading group☆87Updated 6 years ago
- ☆33Updated 4 years ago
- Convolutional Neural Tangent Kernel☆112Updated 6 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 4 years ago
- ☆37Updated 2 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆105Updated 5 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆41Updated 5 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆26Updated last year
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆72Updated last year