deep-lab / DeepnetHessian
Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)
☆17Updated 5 years ago
Alternatives and similar repositories for DeepnetHessian:
Users that are interested in DeepnetHessian are comparing it to the libraries listed below
- The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size☆17Updated 5 years ago
- ☆54Updated 4 years ago
- ☆58Updated last year
- ☆34Updated last year
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- Training vision models with full-batch gradient descent and regularization☆37Updated 2 years ago
- An Investigation of Why Overparameterization Exacerbates Spurious Correlations☆30Updated 4 years ago
- A modern look at the relationship between sharpness and generalization [ICML 2023]☆43Updated last year
- Code for the paper "Understanding Generalization through Visualizations"☆60Updated 4 years ago
- The Pitfalls of Simplicity Bias in Neural Networks [NeurIPS 2020] (http://arxiv.org/abs/2006.07710v2)☆39Updated last year
- Simple data balancing baselines for worst-group-accuracy benchmarks.☆41Updated last year
- NTK reading group☆88Updated 5 years ago
- Distributional and Outlier Robust Optimization (ICML 2021)☆26Updated 3 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- PyTorch implementation of FIM and empirical FIM☆58Updated 6 years ago
- Computing various measures and generalization bounds on convolutional and fully connected networks☆35Updated 6 years ago
- Gradient Starvation: A Learning Proclivity in Neural Networks☆61Updated 4 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- Tilted Empirical Risk Minimization (ICLR '21)☆59Updated last year
- Rethinking Bias-Variance Trade-off for Generalization of Neural Networks☆49Updated 3 years ago
- [ICML'20] Multi Steepest Descent (MSD) for robustness against the union of multiple perturbation models.☆26Updated 6 months ago
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Updated 4 years ago
- Source code of "What can linearized neural networks actually say about generalization?☆20Updated 3 years ago
- Official implementation for Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds (NeurIPS, 2021).☆23Updated 2 years ago
- Contains code for the NeurIPS 2020 paper by Pan et al., "Continual Deep Learning by FunctionalRegularisation of Memorable Past"☆44Updated 4 years ago
- Code for the paper "Adversarial Neural Pruning with Latent Vulnerability Suppression"☆14Updated 2 years ago
- ☆62Updated 3 years ago
- Post-processing for fair classification☆13Updated last month
- Simple CIFAR10 ResNet example with JAX.☆23Updated 3 years ago
- ☆29Updated 4 years ago