LeviViana / torchessian
Full loss Hessian spectrum approximation tool.
☆13Updated 5 years ago
Alternatives and similar repositories for torchessian:
Users that are interested in torchessian are comparing it to the libraries listed below
- PyTorch-SSO: Scalable Second-Order methods in PyTorch☆145Updated last year
- an implementation of L0 regularization with PyTorch☆57Updated 7 years ago
- ☆157Updated 2 years ago
- This repository is no longer maintained. Check☆81Updated 5 years ago
- Code release for Hoogeboom, Emiel, Jorn WT Peters, Rianne van den Berg, and Max Welling. "Integer Discrete Flows and Lossless Compression…☆97Updated 5 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆103Updated 5 years ago
- ☆58Updated 2 years ago
- A Re-implementation of Fixed-update Initialization☆153Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated last month
- ☆28Updated 3 years ago
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Updated 4 years ago
- ☆83Updated 5 years ago
- Implementation of Methods Proposed in Preventing Gradient Attenuation in Lipschitz Constrained Convolutional Networks (NeurIPS 2019)☆34Updated 4 years ago
- Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934☆112Updated 5 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆17Updated 6 years ago
- The Deep Weight Prior, ICLR 2019☆45Updated 3 years ago
- hessian in pytorch☆187Updated 4 years ago
- ☆15Updated 5 years ago
- Hypergradient descent☆145Updated 10 months ago
- ☆42Updated 5 years ago
- Hessian spectral density estimation in TF and Jax☆123Updated 4 years ago
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆49Updated 4 years ago
- ☆144Updated 2 years ago
- Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".☆62Updated 5 years ago
- Code for: Implicit Competitive Regularization in GANs☆114Updated 3 years ago
- A Chainer extension for K-FAC☆20Updated 5 years ago
- ☆33Updated 4 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Updated 5 years ago
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures☆32Updated 4 years ago