End-to-end training of sparse deep neural networks with little-to-no performance loss.
☆335Jan 26, 2023Updated 3 years ago
Alternatives and similar repositories for rigl
Users that are interested in rigl are comparing it to the libraries listed below
Sorting:
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Nov 17, 2021Updated 4 years ago
- Sparse learning library and sparse momentum resources.☆385Jun 6, 2022Updated 3 years ago
- Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020☆29Jan 6, 2022Updated 4 years ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, De…☆45Nov 11, 2023Updated 2 years ago
- A repository in preparation for open-sourcing lottery ticket hypothesis code.☆636Sep 6, 2022Updated 3 years ago
- Soft Threshold Weight Reparameterization for Learnable Sparsity☆91Feb 15, 2023Updated 3 years ago
- Official repository for the "Big Transfer (BiT): General Visual Representation Learning" paper.☆1,539Jul 30, 2024Updated last year
- ☆153May 25, 2020Updated 5 years ago
- Fast Block Sparse Matrices for Pytorch☆549Jan 21, 2021Updated 5 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY☆116Jun 26, 2019Updated 6 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Jan 5, 2021Updated 5 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆105Feb 18, 2020Updated 6 years ago
- ☆621Feb 20, 2026Updated last week
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Nov 8, 2020Updated 5 years ago
- "Learning Rate Dropout" in PyTorch☆34Dec 6, 2019Updated 6 years ago
- Fast and Easy Infinite Neural Networks in Python☆2,375Mar 1, 2024Updated 2 years ago
- [ECMLPKDD 2020] "Topological Insights into Sparse Neural Networks"☆13May 2, 2022Updated 3 years ago
- ☆45Dec 16, 2019Updated 6 years ago
- Discovering Neural Wirings (https://arxiv.org/abs/1906.00586)☆136Feb 20, 2026Updated last week
- Swish Activation - PyTorch CUDA Implementation☆37Oct 10, 2019Updated 6 years ago
- Experiments with the ideas presented in https://arxiv.org/abs/2003.00152 by Frankle et al.☆29Aug 21, 2020Updated 5 years ago
- Identify a binary weight or binary weight and activation subnetwork within a randomly initialized network by only pruning and binarizing …☆51Feb 24, 2022Updated 4 years ago
- Code for "Fast Sparse ConvNets" CVPR2020 submissions☆12Nov 20, 2019Updated 6 years ago
- [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…☆33Apr 9, 2023Updated 2 years ago
- [CVPR 2022] DiSparse: Disentangled Sparsification for Multitask Model Compression☆14Sep 6, 2022Updated 3 years ago
- MONeT framework for reducing memory consumption of DNN training☆174May 4, 2021Updated 4 years ago
- [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…☆18Mar 16, 2022Updated 3 years ago
- ☆222Feb 21, 2023Updated 3 years ago
- FasterAI: A repository for making smaller and faster models with the FastAI library.☆36Mar 4, 2024Updated last year
- ☆41Apr 3, 2021Updated 4 years ago
- ☆21Mar 15, 2023Updated 2 years ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Feb 11, 2023Updated 3 years ago
- Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)☆102Nov 2, 2020Updated 5 years ago
- Official PyTorch implementation of Deformable Grid (ECCV 2020)☆160Nov 5, 2020Updated 5 years ago
- Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"☆1,068Aug 9, 2024Updated last year
- Code for BlockSwap (ICLR 2020).☆33Mar 25, 2021Updated 4 years ago
- PPSpeech: Phrase based Parallel End-to-End TTS System☆35Aug 31, 2020Updated 5 years ago
- [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…☆89Dec 1, 2023Updated 2 years ago
- Code for paper "Adversarial score matching and improved sampling for image generation"☆125Jun 29, 2023Updated 2 years ago