calgaryml / condensed-sparsityLinks
[ICLR 2024] Dynamic Sparse Training with Structured Sparsity
☆21Updated last year
Alternatives and similar repositories for condensed-sparsity
Users that are interested in condensed-sparsity are comparing it to the libraries listed below
Sorting:
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Updated 4 years ago
- ☆222Updated 2 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆36Updated 4 years ago
- ☆233Updated 10 months ago
- ☆17Updated 3 years ago
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆129Updated 2 years ago
- ☆227Updated last year
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆192Updated 2 years ago
- A curated list of awesome resources combining Transformers with Neural Architecture Search☆272Updated 2 years ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆113Updated 2 years ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Updated 2 years ago
- ☆35Updated 3 years ago
- Awesome Pruning. ✅ Curated Resources for Neural Network Pruning.☆172Updated last year
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆59Updated 2 years ago
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆764Updated 5 months ago
- The official implementation of TinyTrain [ICML '24]☆23Updated last year
- ☆36Updated last year
- Comparison of method "Pruning at initialization prior to training" (Synflow/SNIP/GraSP) in PyTorch☆17Updated last year
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆69Updated last year
- A research library for pytorch-based neural network pruning, compression, and more.☆163Updated 3 years ago
- A curated list of early exiting (LLM, CV, NLP, etc)☆69Updated last year
- ☆78Updated last year
- ☆56Updated last year
- ☆194Updated 3 weeks ago
- ☆25Updated last year
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆203Updated last year
- Pytorch implementation of the paper "SNIP: Single-shot Network Pruning based on Connection Sensitivity" by Lee et al.☆110Updated 6 years ago
- Official Implementation of Robustifying and Boosting Training-Free Neural Architecture Search☆10Updated last year
- Official PyTorch Implementation of HELP: Hardware-adaptive Efficient Latency Prediction for NAS via Meta-Learning (NeurIPS 2021 Spotlight…☆63Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆121Updated 6 months ago