orobix / fwdgrad
Implementation of "Gradients without backpropagation" paper (https://arxiv.org/abs/2202.08587) using functorch
☆96Updated last year
Related projects ⓘ
Alternatives and complementary repositories for fwdgrad
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆54Updated 3 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆28Updated 3 years ago
- ☆194Updated last year
- ☆67Updated 5 years ago
- {KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch☆207Updated last month
- ☆208Updated 7 months ago
- Distributed K-FAC Preconditioner for PyTorch☆80Updated last week
- Butterfly matrix multiplication in PyTorch☆164Updated last year
- Pytorch implementation of KFAC and E-KFAC (Natural Gradient).☆128Updated 5 years ago
- Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …☆128Updated last month
- Mode Connectivity and Fast Geometric Ensembles in PyTorch☆265Updated 2 years ago
- ☆16Updated 5 months ago
- Code for the article "What if Neural Networks had SVDs?", to be presented as a spotlight paper at NeurIPS 2020.☆69Updated 4 months ago
- Implementation of Continuous Sparsification, a method for pruning and ticket search in deep networks☆32Updated 2 years ago
- ☆58Updated 2 years ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆46Updated 3 years ago
- Train ImageNet *fast* in 500 lines of code with FFCV☆136Updated 6 months ago
- Create animations for the optimization trajectory of neural nets☆137Updated 9 months ago
- Study on the applicability of Direct Feedback Alignment to neural view synthesis, recommender systems, geometric learning, and natural la…☆85Updated 2 years ago
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆45Updated 9 months ago
- ☆186Updated 3 years ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆76Updated 5 months ago
- Neural Tangent Kernel Papers☆94Updated 8 months ago
- Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"☆97Updated 4 years ago
- Implementations and checkpoints for ResNet, Wide ResNet, ResNeXt, ResNet-D, and ResNeSt in JAX (Flax).☆104Updated 2 years ago
- ASDL: Automatic Second-order Differentiation Library for PyTorch☆179Updated 3 months ago
- [ICML2022] Training Your Sparse Neural Network Better with Any Mask. Ajay Jaiswal, Haoyu Ma, Tianlong Chen, ying Ding, and Zhangyang Wang☆26Updated 2 years ago
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆72Updated last year
- Structured matrices for compressing neural networks☆67Updated last year
- Replicating and dissecting the git-re-basin project in one-click-replication Colabs☆36Updated 2 years ago