calgaryml / condensed-sparsityLinks
[ICLR 2024] Dynamic Sparse Training with Structured Sparsity
☆21Updated last year
Alternatives and similar repositories for condensed-sparsity
Users that are interested in condensed-sparsity are comparing it to the libraries listed below
Sorting:
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Updated 4 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆36Updated 4 years ago
- ☆234Updated 11 months ago
- ☆222Updated 2 years ago
- ☆17Updated 3 years ago
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆771Updated 6 months ago
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆129Updated 2 years ago
- Awesome Pruning. ✅ Curated Resources for Neural Network Pruning.☆173Updated last year
- NAS Benchmarks Collection☆15Updated 2 years ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆114Updated 2 years ago
- Implementation of Continuous Sparsification, a method for pruning and ticket search in deep networks☆34Updated 3 years ago
- ☆228Updated last year
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆79Updated 6 months ago
- The official implementation of TinyTrain [ICML '24]☆23Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆124Updated 6 months ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Updated 2 years ago
- ☆292Updated last year
- ☆35Updated 3 years ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆192Updated 2 years ago
- tiny-imagenet dataset downloader & reader using tensorflow_datasets (tfds) api☆20Updated 6 years ago
- Compare neural networks by their feature similarity☆376Updated 2 years ago
- [ICML 2025] Official Pytorch code for "SASSHA: Sharpness-aware Adaptive Second-order Optimization With Stable Hessian Approximation"☆22Updated 5 months ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆206Updated last year
- ☆28Updated 2 years ago
- A simple and effective LLM pruning approach.☆846Updated last year
- Github Repo for OATS: Outlier-Aware Pruning through Sparse and Low Rank Decomposition☆17Updated 9 months ago
- ☆78Updated last year
- A curated list of awesome resources combining Transformers with Neural Architecture Search☆272Updated 2 years ago
- Comparison of method "Pruning at initialization prior to training" (Synflow/SNIP/GraSP) in PyTorch☆17Updated last year
- Official Implementation of Robustifying and Boosting Training-Free Neural Architecture Search☆10Updated last year