lixilinx / psgd_torch
Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner and more)
☆127Updated last month
Related projects ⓘ
Alternatives and complementary repositories for psgd_torch
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆179Updated 3 months ago
- ☆58Updated 2 years ago
- A functional training loops library for JAX☆85Updated 9 months ago
- scipy linear operators for the Hessian, Fisher/GGN, and more in PyTorch☆18Updated 2 weeks ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆104Updated 2 years ago
- JMP is a Mixed Precision library for JAX.☆187Updated 6 months ago
- Image augmentation library for Jax☆37Updated 7 months ago
- ☆99Updated 4 months ago
- ☆105Updated 2 weeks ago
- LoRA for arbitrary JAX models and functions☆132Updated 8 months ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 3 months ago
- ☆40Updated 4 months ago
- ☆128Updated this week
- ☆97Updated 2 years ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆64Updated last week
- DeepOBS: A Deep Learning Optimizer Benchmark Suite☆103Updated 11 months ago
- Pytorch-like dataloaders in JAX.☆59Updated last month
- ☆16Updated 2 months ago
- Easy-to-use AdaHessian optimizer (PyTorch)☆77Updated 4 years ago
- Hessian spectral density estimation in TF and Jax☆115Updated 4 years ago
- The 2D discrete wavelet transform for JAX☆38Updated last year
- Very deep VAEs in JAX/Flax☆45Updated 3 years ago
- A port of muP to JAX/Haiku☆25Updated 2 years ago
- Scalable neural net training via automatic normalization in the modular norm.☆121Updated 3 months ago
- [NeurIPS'19] Deep Equilibrium Models Jax Implementation☆37Updated 4 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆58Updated 3 years ago
- Riemannian Optimization Using JAX☆45Updated last year
- A Python package of computer vision models for the Equinox ecosystem.☆102Updated 4 months ago
- A simple library for scaling up JAX programs☆127Updated 2 weeks ago
- Neural Networks for JAX☆83Updated last month