f-dangel / sirfshampoo
[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
☆13Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for sirfshampoo
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated last year
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆20Updated 2 weeks ago
- Layerwise Batch Entropy Regularization☆22Updated 2 years ago
- The accompanying code for "Simplifying and Understanding State Space Models with Diagonal Linear RNNs" (Ankit Gupta, Harsh Mehta, Jonatha…☆19Updated last year
- scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch☆18Updated 2 weeks ago
- MaskedTensors for PyTorch☆38Updated 2 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 3 months ago
- ☆62Updated 3 months ago
- Jupyter Notebook corresponding to 'Going with the Flow: An Introduction to Normalizing Flows'☆25Updated 3 years ago
- A home for audio ML in JAX. Has common features, learnable frontends, pretrained supervised and self-supervised models.☆62Updated 2 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆128Updated last month
- An implementation of PSGD Kron second-order optimizer for PyTorch☆16Updated this week
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆69Updated 2 years ago
- ☆35Updated 9 months ago
- Structured matrices for compressing neural networks☆67Updated last year
- ☆33Updated last year
- PyTorch utilities for ML, specifically speech☆13Updated 9 months ago
- code for "Semi-Discrete Normalizing Flows through Differentiable Tessellation"☆24Updated last year
- ☆15Updated last year
- Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch☆38Updated last year
- Efficient Householder Transformation in PyTorch☆62Updated 3 years ago
- ☆36Updated 2 years ago
- [NeurIPS'19] Deep Equilibrium Models Jax Implementation☆37Updated 4 years ago
- ☆22Updated last month
- Visualize, create, and operate on pytrees in the most intuitive way possible.☆41Updated last month
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆120Updated last year
- The official Languini Kitchen repository☆14Updated 6 months ago
- Test pytorch code with minimal computational overhead☆25Updated last year
- Very deep VAEs in JAX/Flax☆45Updated 3 years ago
- Blog post☆16Updated 9 months ago