JunLi-Galios / Optimization-on-Stiefel-Manifold-via-Cayley-Transform
Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform
☆38Updated 6 years ago
Alternatives and similar repositories for Optimization-on-Stiefel-Manifold-via-Cayley-Transform:
Users that are interested in Optimization-on-Stiefel-Manifold-via-Cayley-Transform are comparing it to the libraries listed below
- ☆67Updated 4 months ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆75Updated 9 months ago
- ☆30Updated 4 years ago
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆132Updated 5 years ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆49Updated 4 years ago
- ☆47Updated 5 years ago
- ☆36Updated 3 years ago
- Monotone operator equilibrium networks☆51Updated 4 years ago
- The codebase for the paper "A Tail-Index Analysis of Stochastic Gradient Noise in Deep Neural Networks"☆25Updated 5 years ago
- ☆58Updated 2 years ago
- ☆66Updated 6 years ago
- Visualization of mean field and neural tangent kernel regime☆20Updated 9 months ago
- Good Subnetworks Provably Exist: Pruning via Greedy Forward Selection☆21Updated 4 years ago
- Code base for SRSGD.☆28Updated 5 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆103Updated 5 years ago
- Structured matrices for compressing neural networks☆66Updated last year
- Implementations of orthogonal and semi-orthogonal convolutions in the Fourier domain with applications to adversarial robustness☆44Updated 4 years ago
- Code for testing DCT plus Sparse (DCTpS) networks☆14Updated 3 years ago
- Code for the ICML 2021 and ICLR 2022 papers: Skew Orthogonal Convolutions, Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100☆18Updated 3 years ago
- Measurements of Three-Level Hierarchical Structure in the Outliers in the Spectrum of Deepnet Hessians (ICML 2019)☆17Updated 5 years ago
- Limitations of the Empirical Fisher Approximation☆47Updated last month
- Towards Understanding Sharpness-Aware Minimization [ICML 2022]☆35Updated 2 years ago
- Code for "The Intrinsic Dimension of Images and Its Impact on Learning" - ICLR 2021 Spotlight https://openreview.net/forum?id=XJk19XzGq2J☆68Updated last year
- Lipschitz Neural Networks described in "Sorting Out Lipschitz Function Approximation" (ICML 2019).☆55Updated 4 years ago
- Code for the intrinsic dimensionality estimate of data representations☆80Updated 5 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Updated 4 years ago
- Code for Knowledge-Adaptation Priors based on the NeurIPS 2021 paper by Khan and Swaroop.☆16Updated 3 years ago
- ☆45Updated 5 years ago
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆12Updated last year
- Repository containing Pytorch code for EKFAC and K-FAC perconditioners.☆142Updated last year