calgaryml / condensed-sparsityLinks
[ICLR 2024] Dynamic Sparse Training with Structured Sparsity
☆21Updated last year
Alternatives and similar repositories for condensed-sparsity
Users that are interested in condensed-sparsity are comparing it to the libraries listed below
Sorting:
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Updated 4 years ago
- ☆221Updated 2 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆36Updated 4 years ago
- ☆227Updated last year
- tiny-imagenet dataset downloader & reader using tensorflow_datasets (tfds) api☆20Updated 6 years ago
- ☆17Updated 3 years ago
- ☆234Updated 10 months ago
- Awesome Pruning. ✅ Curated Resources for Neural Network Pruning.☆173Updated last year
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆201Updated last year
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆192Updated 2 years ago
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆760Updated 5 months ago
- A curated list of awesome resources combining Transformers with Neural Architecture Search☆271Updated 2 years ago
- Compare neural networks by their feature similarity☆376Updated 2 years ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Updated 2 years ago
- ☆36Updated last year
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆113Updated 2 years ago
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆382Updated this week
- ☆193Updated this week
- ☆287Updated last year
- A research library for pytorch-based neural network pruning, compression, and more.☆163Updated 3 years ago
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆129Updated 2 years ago
- In progress.☆67Updated last year
- ☆35Updated 3 years ago
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆59Updated 2 years ago
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆119Updated 5 months ago
- Comparison of method "Pruning at initialization prior to training" (Synflow/SNIP/GraSP) in PyTorch☆17Updated last year
- Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020☆29Updated 3 years ago
- Train ImageNet *fast* in 500 lines of code with FFCV☆149Updated last year
- [ICML 2025] Official Pytorch code for "SASSHA: Sharpness-aware Adaptive Second-order Optimization With Stable Hessian Approximation"☆19Updated 4 months ago
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆74Updated 5 months ago