JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
☆38Updated 5 years ago
Alternatives and similar repositories for Optimization-on-Stiefel-Manifold-via-Cayley-Transform:
Users that are interested in Optimization-on-Stiefel-Manifold-via-Cayley-Transform are comparing it to the libraries listed below
- ☆58Updated 2 years ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆49Updated 4 years ago
- ☆65Updated 3 months ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆131Updated 5 years ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆106Updated 4 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆74Updated 8 months ago
- Code for Knowledge-Adaptation Priors based on the NeurIPS 2021 paper by Khan and Swaroop.☆16Updated 3 years ago
- ☆66Updated 6 years ago
- ☆31Updated 4 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆103Updated 5 years ago
- Distributed K-FAC Preconditioner for PyTorch☆85Updated last week
- Estimating Gradients for Discrete Random Variables by Sampling without Replacement☆40Updated 5 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆17Updated 5 years ago
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆44Updated 3 years ago
- ☆47Updated 5 years ago
- Convolutional Neural Tangent Kernel☆111Updated 5 years ago
- Pytorch code for "Improving Self-Supervised Learning by Characterizing Idealized Representations"☆40Updated 2 years ago
- ☆36Updated 3 years ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 8 months ago
- Structured matrices for compressing neural networks☆66Updated last year
- Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection☆21Updated 4 years ago
- The codebase for the paper "A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks"☆25Updated 5 years ago
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Updated 4 years ago
- TedNet: A Pytorch Toolkit for Tensor Decomposition Networks☆94Updated 2 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Updated 4 years ago
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆31Updated 3 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- ☆122Updated 10 months ago