lixilinx / psgd_torchLinks
Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation preconditioner and more)
☆188Updated last month
Alternatives and similar repositories for psgd_torch
Users that are interested in psgd_torch are comparing it to the libraries listed below
Sorting:
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆190Updated 11 months ago
- A library for unit scaling in PyTorch☆132Updated 4 months ago
- ☆222Updated 11 months ago
- 🧱 Modula software package☆303Updated 2 months ago
- LoRA for arbitrary JAX models and functions☆142Updated last year
- ☆61Updated last year
- ☆60Updated 3 years ago
- Parameter-Free Optimizers for Pytorch☆131Updated last year
- ☆234Updated 9 months ago
- Code implementing "Efficient Parallelization of a Ubiquitious Sequential Computation" (Heinsen, 2023)☆96Updated 11 months ago
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆74Updated 4 months ago
- MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…☆400Updated last week
- JMP is a Mixed Precision library for JAX.☆211Updated 9 months ago
- Unofficial JAX implementations of deep learning research papers☆159Updated 3 years ago
- ☆285Updated last year
- A simple library for scaling up JAX programs☆144Updated last week
- A functional training loops library for JAX☆88Updated last year
- Named tensors with first-class dimensions for PyTorch☆331Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆131Updated 3 years ago
- CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds☆324Updated 4 months ago
- ☆39Updated last year
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆115Updated 3 years ago
- JAX Synergistic Memory Inspector☆179Updated last year
- minGPT in JAX☆48Updated 3 years ago
- Running Jax in PyTorch Lightning☆113Updated 11 months ago
- Differentiable Algorithms and Algorithmic Supervision.☆116Updated 2 years ago
- Open source code for EigenGame.☆33Updated 2 years ago
- ☆17Updated last year
- Efficient optimizers☆275Updated this week
- ☆159Updated last year