facebookresearch / projUNNLinks
Fast training of unitary deep network layers from low-rank updates
☆28Updated 2 years ago
Alternatives and similar repositories for projUNN
Users that are interested in projUNN are comparing it to the libraries listed below
Sorting:
- Distributed K-FAC preconditioner for PyTorch☆91Updated this week
- Butterfly matrix multiplication in PyTorch☆174Updated 2 years ago
- ☆234Updated 8 months ago
- JMP is a Mixed Precision library for JAX.☆207Updated 8 months ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆190Updated 10 months ago
- Pytorch implementation of preconditioned stochastic gradient descent (Kron and affine preconditioner, low-rank approximation precondition…☆183Updated 3 weeks ago
- Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch☆113Updated 2 years ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆76Updated last year
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆80Updated last year
- Running Jax in PyTorch Lightning☆112Updated 10 months ago
- If it quacks like a tensor...☆59Updated 11 months ago
- Differentiable Algorithms and Algorithmic Supervision.☆116Updated 2 years ago
- ☆33Updated last year
- Experiment of using Tangent to autodiff triton☆80Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX☆88Updated last year
- Stochastic Automatic Differentiation library for PyTorch.☆208Updated last year
- Open source code for EigenGame.☆32Updated 2 years ago
- Code accompanying our paper "Feature Learning in Infinite-Width Neural Networks" (https://arxiv.org/abs/2011.14522)☆63Updated 4 years ago
- ☆39Updated last year
- A library for unit scaling in PyTorch☆130Updated 3 months ago
- A simple library for scaling up JAX programs☆144Updated 11 months ago
- LoRA for arbitrary JAX models and functions☆141Updated last year
- Omnigrok: Grokking Beyond Algorithmic Data☆62Updated 2 years ago
- ☆158Updated last year
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆215Updated last month
- ☆58Updated last year
- ☆115Updated last month
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- Create animations for the optimization trajectory of neural nets☆159Updated last year
- Multi-framework implementation of Deep Kernel Shaping and Tailored Activation Transformations, which are methods that modify neural netwo…☆74Updated 3 months ago