This repository is the official implementation of the paper Pruning via Iterative Ranking of Sensitivity Statistics and implements novel pruning / compression algorithms for deep learning / neural networks. Amongst others it implements structured pruning before training, its actual parameter shrinking and unstructured before/during training.
☆32May 22, 2023Updated 2 years ago
Alternatives and similar repositories for SNIP-it
Users that are interested in SNIP-it are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Mar 5, 2021Updated 5 years ago
- ☆13Mar 8, 2020Updated 6 years ago
- A Signal Propagation Perspective for Pruning Neural Networks at Initialization☆14Jun 23, 2020Updated 5 years ago
- Code for Sanity-Checking Pruning Methods: Random Tickets can Win the Jackpot☆42Nov 8, 2020Updated 5 years ago
- Single shot neural network pruning before training the model, based on connection sensitivity☆11Aug 7, 2019Updated 6 years ago
- Codebase for the paper "A Gradient Flow Framework for Analyzing Network Pruning"☆20Jan 31, 2021Updated 5 years ago
- The Search for Sparse, Robustness Neural Networks☆11Mar 24, 2023Updated 2 years ago
- VAE with RealNVP prior and Super-Resolution VAE in PyTorch. Code release for https://arxiv.org/abs/2006.05218.☆77Sep 1, 2020Updated 5 years ago
- Prospect Pruning: Finding Trainable Weights at Initialization Using Meta-Gradients☆32Mar 30, 2022Updated 3 years ago
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Nov 17, 2021Updated 4 years ago
- Pytorch implementation of the paper "SNIP: Single-shot Network Pruning based on Connection Sensitivity" by Lee et al.☆109Apr 23, 2019Updated 6 years ago
- DeepHoyer: Learning Sparser Neural Network with Differentiable Scale-Invariant Sparsity Measures☆32Aug 13, 2020Updated 5 years ago
- reanalysis of the ObjectNet paper and our annotations and code☆16Mar 4, 2021Updated 5 years ago
- For replication of the experiments in the paper Learning Robust Representations by Projecting Superficial Statistics Out☆13Oct 22, 2019Updated 6 years ago
- Code for CHIP: CHannel Independence-based Pruning for Compact Neural Networks (NeruIPS 2021).☆39Sep 10, 2022Updated 3 years ago
- Variational Bayes for NN in Torch7 (http://papers.nips.cc/paper/4329-practical-variational-inference-for-neural-networks.pdf)☆10Mar 23, 2015Updated 11 years ago
- Code for my paper "Fixed-Form Variational Posterior Approximation through Stochastic Linear Regression"☆11Sep 15, 2013Updated 12 years ago
- A tutorial on learned non-adversarial invariance in neural networks☆14Dec 8, 2019Updated 6 years ago
- ☆25Jun 5, 2019Updated 6 years ago
- SNIP: SINGLE-SHOT NETWORK PRUNING BASED ON CONNECTION SENSITIVITY☆115Jun 26, 2019Updated 6 years ago
- This repository implements the paper "Effective Training of Convolutional Neural Networks with Low-bitwidth Weights and Activations"☆20Aug 30, 2021Updated 4 years ago
- ☆229Jul 25, 2024Updated last year
- Implementation of the iPiano algorithm for non-convex and non-smooth optimization as described in [1].☆12Nov 28, 2018Updated 7 years ago
- [NeurIPS'2019] Shupeng Gui, Haotao Wang, Haichuan Yang, Chen Yu, Zhangyang Wang, Ji Liu, “Model Compression with Adversarial Robustness: …☆49Dec 30, 2021Updated 4 years ago
- [ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun…☆40Mar 20, 2022Updated 4 years ago
- Proximal Mean-field for Neural Network Quantization☆21Apr 9, 2020Updated 5 years ago
- Implementation of unregularized, l1 regularized and l2 regularized linear regression using numpy and without sklearn☆12Oct 4, 2019Updated 6 years ago
- ☆10Aug 15, 2023Updated 2 years ago
- This repository contains the code for our ECCV 2022 paper on our "Non-isotropic Probabilistic Take on Proxy-based Deep Metric Learning".☆12Dec 6, 2022Updated 3 years ago
- Knowledge distillation from Ensembles of Iterative pruning (BMVC 2020)☆25Aug 13, 2020Updated 5 years ago
- An implementation of Jasper, QuartzNet, Citrinet and pipeline for training CTC-based ASR models☆12Nov 13, 2021Updated 4 years ago
- Lookahead: A Far-sighted Alternative of Magnitude-based Pruning (ICLR 2020)☆32Oct 25, 2020Updated 5 years ago
- Successfully training approximations to full-rank matrices for efficiency in deep learning.☆17Jan 5, 2021Updated 5 years ago
- ☆69Mar 4, 2020Updated 6 years ago
- ☆55Jan 8, 2019Updated 7 years ago
- Codes for paper "Few Shot Network Compression via Cross Distillation", AAAI 2020.☆31Jan 31, 2020Updated 6 years ago
- ☆11May 29, 2020Updated 5 years ago
- Download Activity Net Videos☆10Nov 3, 2015Updated 10 years ago
- Hybrid Binary Networks: Optimizing for Accuracy, Efficiency and Memory - WACV18☆12Jul 5, 2019Updated 6 years ago