lixilinx / psgd_torchLinks
Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditioner and more)
☆183Updated last week
Alternatives and similar repositories for psgd_torch
Users that are interested in psgd_torch are comparing it to the libraries listed below
Sorting:
- ☆60Updated 3 years ago
- Parameter-Free Optimizers for Pytorch☆130Updated last year
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆190Updated 10 months ago
- JMP is a Mixed Precision library for JAX.☆208Updated 8 months ago
- 🧱 Modula software package☆277Updated last month
- LoRA for arbitrary JAX models and functions☆142Updated last year
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆72Updated 3 months ago
- ☆215Updated 10 months ago
- A simple library for scaling up JAX programs☆143Updated 11 months ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆93Updated 10 months ago
- A functional training loops library for JAX☆88Updated last year
- ☆39Updated last year
- minGPT in JAX☆48Updated 3 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- ☆58Updated last year
- Running Jax in PyTorch Lightning☆113Updated 9 months ago
- ☆281Updated last year
- ☆233Updated 7 months ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆129Updated 3 years ago
- ☆17Updated last year
- ☆247Updated 3 months ago
- A library for unit scaling in PyTorch☆130Updated 2 months ago
- ☆115Updated last month
- Run PyTorch in JAX. 🤝☆294Updated last month
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆112Updated 3 years ago
- Optimization algorithm which fits a ResNet to CIFAR-10 5x faster than SGD / Adam (with terrible generalization)☆14Updated last year
- Automatically take good care of your preemptible TPUs☆36Updated 2 years ago
- Efficient optimizers☆265Updated this week
- ☆43Updated 2 months ago
- JAX Synergistic Memory Inspector☆180Updated last year