deep-lab / DeepnetHessianLinks
Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)
☆17Updated 6 years ago
Alternatives and similar repositories for DeepnetHessian
Users that are interested in DeepnetHessian are comparing it to the libraries listed below
Sorting:
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆17Updated 6 years ago
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 3 years ago
- Code for the paper "Understanding Generalization through Visualizations"☆61Updated 4 years ago
- ☆55Updated 4 years ago
- ☆59Updated 2 years ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆41Updated last year
- ☆34Updated last year
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆31Updated 5 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆27Updated 4 years ago
- Training vision models with full-batch gradient descent and regularization☆37Updated 2 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆42Updated last year
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 6 years ago
- ☆157Updated 3 years ago
- Simple CIFAR10 ResNet example with JAX.☆23Updated 4 years ago
- NTK reading group☆87Updated 5 years ago
- AMO algorithm from the following paper: https://arxiv.org/abs/1910.04284.☆8Updated 5 years ago
- Weight-Averaged Sharpness-Aware Minimization (NeurIPS 2022)☆28Updated 2 years ago
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 4 years ago
- Coresets via Bilevel Optimization☆66Updated 4 years ago
- Convolutional Neural Tangent Kernel☆113Updated 5 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆144Updated 2 years ago
- PyTorch implementation of FIM and empirical FIM☆61Updated 7 years ago
- [NeurIPS 2021] A Geometric Analysis of Neural Collapse with Unconstrained Features☆58Updated 3 years ago
- Lipschitz Neural Networks described in "Sorting Out Lipschitz Function Approximation" (ICML 2019).☆56Updated 5 years ago
- Mode Connectivity and Fast Geometric Ensembles in PyTorch☆272Updated 2 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 4 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆26Updated last year
- Code for "Just Train Twice: Improving Group Robustness without Training Group Information"☆72Updated last year
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago