calgaryml / condensed-sparsityLinks
[ICLR 2024] Dynamic Sparse Training with Structured Sparsity
☆21Updated last year
Alternatives and similar repositories for condensed-sparsity
Users that are interested in condensed-sparsity are comparing it to the libraries listed below
Sorting:
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆36Updated 4 years ago
- Lightweight torch implementation of rigl, a sparse-to-sparse optimizer.☆60Updated 4 years ago
- ☆17Updated 3 years ago
- ☆222Updated 2 years ago
- ☆234Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆123Updated 7 months ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregeneration☆31Updated 3 years ago
- ☆25Updated last year
- ☆13Updated 4 months ago
- ☆228Updated last year
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆773Updated 7 months ago
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆129Updated 2 years ago
- ☆291Updated last year
- Pytorch code of [CVPR 2023] "NAR-Former: Neural Architecture Representation Learning towards Holistic Attributes Prediction".☆11Updated 2 years ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆206Updated 2 years ago
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Updated 2 years ago
- ☆36Updated last year
- A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...☆390Updated last month
- Awesome Pruning. ✅ Curated Resources for Neural Network Pruning.☆173Updated last year
- Official Pytorch Implementation of "Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity"☆80Updated 7 months ago
- ☆44Updated 2 years ago
- [KDD 2023] code for "Test accuracy vs. generalization gap: model selection in NLP without accessing training or testing data" https://arx…☆12Updated 3 years ago
- A curated list of early exiting (LLM, CV, NLP, etc)☆70Updated last year
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.☆59Updated 2 years ago
- ☆40Updated 2 months ago
- EP☆18Updated 4 years ago
- Code to simulate energy-based analog systems and equilibrium propagation☆31Updated 10 months ago
- ☆35Updated 3 years ago
- Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer☆23Updated last year
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆114Updated 2 years ago