ZiweiWangTHU / Quantformer
This is the official pytorch implementation for the paper: *Quantformer: Learning Extremely Low-precision Vision Transformers*.
☆20Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for Quantformer
- This is the official pytorch implementation for the paper: Towards Accurate Post-training Quantization for Diffusion Models.(CVPR24 Poste…☆32Updated 5 months ago
- ☆42Updated last year
- ☆10Updated last year
- [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric☆51Updated last year
- Pytorch implementation of RAPQ, IJCAI 2022☆21Updated last year
- The official implementation of the NeurIPS 2022 paper Q-ViT.☆83Updated last year
- This is the pytorch implementation for the paper: Generalizable Mixed-Precision Quantization via Attribution Rank Preservation, which is…☆24Updated 3 years ago
- [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer☆31Updated 11 months ago
- An official PyTorch implementation of the paper "Distance-aware Quantization", ICCV 2021.☆46Updated 2 weeks ago
- torch_quantizer is a out-of-box quantization tool for PyTorch models on CUDA backend, specially optimized for Diffusion Models.☆18Updated 7 months ago
- [CVPR'23] SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer☆61Updated 6 months ago
- ☆34Updated last year
- Collections of model quantization algorithms. Any issues, please contact Peng Chen (blueardour@gmail.com)☆68Updated 3 years ago
- ☆41Updated 2 months ago
- [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…☆34Updated last month
- BinaryViT: Pushing Binary Vision Transformers Towards Convolutional Models☆31Updated 9 months ago
- ☆11Updated 5 months ago
- The official implementation of BiViT: Extremely Compressed Binary Vision Transformers☆12Updated last year
- LSQ+ or LSQplus☆59Updated last year
- [ICCV 23]An approach to enhance the efficiency of Vision Transformer (ViT) by concurrently employing token pruning and token merging tech…☆89Updated last year
- Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies☆11Updated 2 years ago
- super-resolution; post-training quantization; model compression☆10Updated last year
- [TPAMI 2024] This is the official repository for our paper: ''Pruning Self-attentions into Convolutional Layers in Single Path''.☆107Updated 10 months ago
- [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …☆69Updated 2 years ago
- ☆16Updated 2 years ago
- Pytorch implementation of TPAMI 2022 -- 1xN Pattern for Pruning Convolutional Neural Networks☆44Updated 2 years ago
- Code for RepNAS☆13Updated 2 years ago
- PyTorch implementation of SSQL (Accepted to ECCV2022 oral presentation)☆75Updated last year
- [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…☆36Updated 8 months ago
- ☆17Updated 2 years ago