f-dangel / sirfshampooLinks
[ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
☆14Updated 10 months ago
Alternatives and similar repositories for sirfshampoo
Users that are interested in sirfshampoo are comparing it to the libraries listed below
Sorting:
- ☆66Updated last year
- A home for audio ML in JAX. Has common features, learnable frontends, pretrained supervised and self-supervised models.☆69Updated 3 years ago
- ☆24Updated 11 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆181Updated this week
- A minimal Pytorch Implementation of Stochastically Quantized Variational AutoEncoder (SQ-VAE) by Sony☆33Updated last year
- Official code for Long Expressive Memory (ICLR 2022, Spotlight)☆70Updated 3 years ago
- Code repository of the paper "Wavelet Networks: Scale-Translation Equivariant Learning From Raw Time-Series, TMLR" https://arxiv.org/abs…☆83Updated last year
- Layerwise Batch Entropy Regularization☆23Updated 3 years ago
- [TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivative…☆17Updated 2 years ago
- The accompanying code for "Simplifying and Understanding State Space Models with Diagonal Linear RNNs" (Ankit Gupta, Harsh Mehta, Jonatha…☆23Updated 2 years ago
- ☆164Updated 2 years ago
- Short-time Fourier transform (STFT) for JAX☆14Updated 3 years ago
- Adaptive Gradient Clipping☆147Updated 2 years ago
- Inspired by "Neural Networks Fail to Learn Periodic Functions and How to Fix It"☆67Updated 2 months ago
- An implementation of Variational Autoencoders with a constant balance between reconstruction error and Kullback-leibler divergence☆20Updated 3 weeks ago
- Easy Hypernetworks in Pytorch and Jax☆105Updated 2 years ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆79Updated 4 years ago
- Jax/Flax implementation of Variational-DiffWave.☆40Updated 3 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆189Updated 9 months ago
- A tool for assignment to a slice in TensorFlow☆20Updated 4 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆76Updated last year
- Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)☆127Updated last year
- ☆31Updated 4 years ago
- [ICML 2024] SINGD: KFAC-like Structured Inverse-Free Natural Gradient Descent (http://arxiv.org/abs/2312.05705)☆22Updated 10 months ago
- ☆17Updated last year
- ☆60Updated 5 years ago
- PyTorch implementations of normalizing flow and its variants.☆78Updated 4 years ago
- ☆36Updated last year
- Sequence Modeling with Structured State Spaces☆66Updated 3 years ago
- Continuous Augmented Positional Embeddings (CAPE) implementation for PyTorch☆42Updated 2 years ago