This repository is the official implementation of the paper Pruning via Iterative Ranking of Sensitivity Statistics and implements novel pruning / compression algorithms for deep learning / neural networks. Amongst others it implements structured pruning before training, its actual parameter shrinking and unstructured before/during training.
☆33May 22, 2023Updated 3 years ago
Alternatives and similar repositories for SNIP-it
Users that are interested in SNIP-it are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Mar 5, 2021Updated 5 years ago
- ☆13Mar 8, 2020Updated 6 years ago
- A Signal Propagation Perspective for Pruning Neural Networks at Initialization☆14Jun 23, 2020Updated 6 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆43Nov 8, 2020Updated 5 years ago
- Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH☆105Feb 18, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Single shot neural network pruning before training the model, based on connection sensitivity☆11Aug 7, 2019Updated 6 years ago
- Codebase for the paper "A Gradient Flow Framework for Analyzing Network Pruning"☆20Jan 31, 2021Updated 5 years ago
- The Search for Sparse, Robustness Neural Networks☆11Mar 24, 2023Updated 3 years ago
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆32Mar 30, 2022Updated 4 years ago
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Jul 6, 2026Updated 2 weeks ago
- [AISTATS2020] The official repository of "Invertible Generative Modling using Linear Rational Splines (LRS)".☆20May 12, 2023Updated 3 years ago
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures☆32Aug 13, 2020Updated 5 years ago
- Code for CHIP: CHannel Independence-based Pruning for Compact Neural Networks (NeruIPS 2021).☆41Sep 10, 2022Updated 3 years ago
- This work introduces LaT-PFN, a novel time series model that combines PFN and JEPA frameworks to generate zero-shot forecasts efficientl…☆22Aug 1, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020☆29Jan 6, 2022Updated 4 years ago
- ☆20May 28, 2019Updated 7 years ago
- ☆25Jun 5, 2019Updated 7 years ago
- PyTorch Lightning implementation of the paper Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and H…☆36Dec 17, 2024Updated last year
- This repository implements the paper "Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations"☆20Aug 30, 2021Updated 4 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY☆115Jun 26, 2019Updated 7 years ago
- ☆229Jul 25, 2024Updated last year
- [ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun…☆40Mar 20, 2022Updated 4 years ago
- [NeurIPS'2019] Shupeng Gui, Haotao Wang, Haichuan Yang, Chen Yu, Zhangyang Wang, Ji Liu, “Model Compression with Adversarial Robustness: …☆48Dec 30, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Proximal Mean-field for Neural Network Quantization☆21Apr 9, 2020Updated 6 years ago
- [ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen…☆28Aug 29, 2023Updated 2 years ago
- PyTorch code for full quantization of DNN using BCGD☆14Jul 24, 2019Updated 6 years ago
- Knowledge distillation from Ensembles of Iterative pruning (BMVC 2020)☆25Aug 13, 2020Updated 5 years ago
- ☆55Jan 8, 2019Updated 7 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆16Jan 5, 2021Updated 5 years ago
- Lookahead: A Far-sighted Alternative of Magnitude-based Pruning (ICLR 2020)☆32Oct 25, 2020Updated 5 years ago
- ☆68Mar 4, 2020Updated 6 years ago
- Codes for paper "Few Shot Network Compression via Cross Distillation", AAAI 2020.☆30Jan 31, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆11May 29, 2020Updated 6 years ago
- ☆13Oct 28, 2019Updated 6 years ago
- Fork of Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://nervanasystems.githu…☆16Jun 6, 2025Updated last year
- source code of the paper: Robust Quantization: One Model to Rule Them All☆42Mar 24, 2023Updated 3 years ago
- ☆15Jan 8, 2020Updated 6 years ago
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆433Jul 7, 2023Updated 3 years ago
- Official Code of The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks[ICML2022]☆16Sep 20, 2022Updated 3 years ago