Model-Compression / Lossless_CompressionLinks
We propose a lossless compression algorithm based on the NTK matrix for DNN. The compressed network yields asymptotically the same NTK as the original (dense and unquantized) network, with its weights and activations taking values only in {0, 1, -1} up to scaling.
☆24Updated last year
Alternatives and similar repositories for Lossless_Compression
Users that are interested in Lossless_Compression are comparing it to the libraries listed below
Sorting:
- Implementation of PGONAS for CVPR22W and RD-NAS for ICASSP23☆22Updated 2 years ago
- ☆41Updated 4 years ago
- [NeurIPS 2024] Search for Efficient LLMs☆14Updated 4 months ago
- Personal Digest of NAS (Under Construction 🛠)☆25Updated 4 years ago
- [NeurIPS 2021] “Stronger NAS with Weaker Predictors“, Junru Wu, Xiyang Dai, Dongdong Chen, Yinpeng Chen, Mengchen Liu, Ye Yu, Zhangyang W…☆27Updated 2 years ago
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated 2 years ago
- [ICCV 2023] Efficient Joint Optimization of Layer-Adaptive Weight Pruning in Deep Neural Networks☆24Updated last year
- ☆17Updated 3 years ago
- Source code of our TNNLS paper "Boosting Convolutional Neural Networks with Middle Spectrum Grouped Convolution"☆12Updated 2 years ago
- ☆22Updated 7 months ago
- [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)☆32Updated 2 years ago
- [ACL'22] Training-free Neural Architecture Search for RNNs and Transformers☆14Updated last year
- Code for High-Capacity Expert Binary Networks (ICLR 2021).☆27Updated 3 years ago
- Macro Neural Architecture Search Benchmark☆16Updated 2 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆14Updated 3 months ago
- ☆21Updated 2 years ago
- Code for RepNAS☆13Updated 3 years ago
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆23Updated 3 years ago
- Data-Free Neural Architecture Search via Recursive Label Calibration. ECCV 2022.☆32Updated 2 years ago
- The code for Joint Neural Architecture Search and Quantization☆13Updated 6 years ago
- ☆25Updated 3 years ago
- ☆13Updated 3 years ago
- This is the pytorch implementation for the paper: Generalizable Mixed-Precision Quantization via Attribution Rank Preservation, which is…☆25Updated 3 years ago
- ☆24Updated 3 years ago
- Pytorch implementation of our paper (TNNLS) -- Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters☆12Updated 3 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Updated last year
- ProxylessNAS-Pytorch☆23Updated 5 years ago
- ☆11Updated 2 years ago
- [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…☆30Updated 3 years ago
- Unofficial pytorch implementation of Piecewise Linear Unit dynamic activation function☆17Updated 2 years ago