pvti / Awesome-Tensor-Decomposition
π A curated list of tensor decomposition resources for model compression.
β43Updated this week
Alternatives and similar repositories for Awesome-Tensor-Decomposition:
Users that are interested in Awesome-Tensor-Decomposition are comparing it to the libraries listed below
- Efficient tensor decomposition-based filter pruningβ15Updated 7 months ago
- β12Updated 3 years ago
- TedNet: A Pytorch Toolkit for Tensor Decomposition Networksβ93Updated 2 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)β30Updated 3 months ago
- Collect optimizer related papers, data, repositoriesβ87Updated 3 months ago
- [IJCAI'22 Survey] Recent Advances on Neural Network Pruning at Initialization.β58Updated last year
- Code for ICCV23 paper "Automatic network pruning via Hilbert Schmidt independence criterion lasso under information bottleneck principle"β17Updated last year
- [ICLR 2023] Pruning Deep Neural Networks from a Sparsity Perspectiveβ24Updated last year
- β21Updated 11 months ago
- Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.β143Updated 5 months ago
- [CVPR 2024] Offical implementation for A&B BNN: Add&Bit-Operation-Only Hardware-Friendly Binary Neural Networkβ21Updated 2 months ago
- [ICML 2021] "Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training" by Shiwei Liu, Lu Yin, Deβ¦β46Updated last year
- MNIST experiment from Tensorizing neural networks (Novikov et al. 2015)β13Updated 5 years ago
- β39Updated last year
- [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binarβ¦β54Updated 11 months ago
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)β14Updated 6 months ago
- [Neurips 2021] Sparse Training via Boosting Pruning Plasticity with Neuroregenerationβ31Updated 2 years ago
- BinaryViT: Pushing Binary Vision Transformers Towards Convolutional Modelsβ32Updated last year
- Code for CHIP: CHannel Independence-based Pruning for Compact Neural Networks (NeruIPS 2021).β33Updated 2 years ago
- β49Updated last year
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformerβ32Updated last year
- β224Updated 6 months ago
- β75Updated 2 years ago
- Apply CP, Tucker, TT/TR, HT to compress neural networks. Train from scratch.β12Updated 4 years ago
- In progress.β63Updated 10 months ago
- β25Updated 3 years ago
- Pytorch implementation of our paper accepted by ICCV 2021 -- ReCU: Reviving the Dead Weights in Binary Neural Networks http://arxiv.org/aβ¦β39Updated 3 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Diβ¦β50Updated 4 months ago
- [NeurIPS 2024] AlphaPruning: Using Heavy-Tailed Self Regularization Theory for Improved Layer-wise Pruning of Large Language Modelsβ21Updated last month
- To appear in the 11th International Conference on Learning Representations (ICLR 2023).β16Updated last year