Model-Compression / Lossless_CompressionLinks
We propose a lossless compression algorithm based on the NTK matrix for DNN. The compressed network yields asymptotically the same NTK as the original (dense and unquantized) network, with its weights and activations taking values only in {0, 1, -1} up to scaling.
☆24Updated last year
Alternatives and similar repositories for Lossless_Compression
Users that are interested in Lossless_Compression are comparing it to the libraries listed below
Sorting:
- Implementation of PGONAS for CVPR22W and RD-NAS for ICASSP23☆22Updated 2 years ago
- [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…☆40Updated 2 years ago
- ☆21Updated 2 years ago
- Official codebase for our paper "Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks"☆12Updated 4 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Updated last year
- Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)☆24Updated last year
- [NeurIPS 2021] “Stronger NAS with Weaker Predictors“, Junru Wu, Xiyang Dai, Dongdong Chen, Yinpeng Chen, Mengchen Liu, Ye Yu, Zhangyang W…☆27Updated 2 years ago
- ☆24Updated 3 years ago
- The reproduce for "AM-LFS: AutoML for Loss Function Search"☆14Updated 5 years ago
- ☆20Updated 2 years ago
- [NeurIPS 2024] Search for Efficient LLMs☆14Updated 6 months ago
- Code for RepNAS☆13Updated 3 years ago
- ☆13Updated 4 years ago
- Official Pytorch implementation of Super Vision Transformer (IJCV)☆43Updated last year
- Pytorch implementation (TPAMI 2023) - Training Compact CNNs for Image Classification using Dynamic-coded Filter Fusion☆19Updated 2 years ago
- Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 -- Distilling a Powerful Student Model via Online Knowledge Distillation☆29Updated 3 years ago
- [ACL'22] Training-free Neural Architecture Search for RNNs and Transformers☆14Updated last year
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆23Updated 3 years ago
- Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"☆65Updated 2 years ago
- This repo is the official megengine implementation of the ECCV2022 paper: Efficient One Pass Self-distillation with Zipf's Label Smoothin…☆26Updated 2 years ago
- ☆25Updated 3 years ago
- Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022☆36Updated 2 years ago
- [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…☆53Updated last year
- Revisiting Parameter Sharing for Automatic Neural Channel Number Search, NeurIPS 2020☆21Updated 4 years ago
- ☆11Updated 2 years ago
- Data-Free Neural Architecture Search via Recursive Label Calibration. ECCV 2022.☆32Updated 2 years ago
- ☆41Updated 4 years ago
- Source code of our TNNLS paper "Boosting Convolutional Neural Networks with Middle Spectrum Grouped Convolution"☆12Updated 2 years ago
- ☆26Updated last year
- ☆46Updated last year