DD-DuDa / awesome-vit-quantization-acceleration
List of papers related to Vision Transformers quantization and hardware acceleration in recent AI conferences and journals.
☆78Updated 9 months ago
Alternatives and similar repositories for awesome-vit-quantization-acceleration:
Users that are interested in awesome-vit-quantization-acceleration are comparing it to the libraries listed below
- Post-Training Quantization for Vision transformers.☆209Updated 2 years ago
- [HPCA 2023] ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design☆103Updated last year
- [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metric☆52Updated 2 years ago
- ☆93Updated last year
- EQ-Net [ICCV 2023]☆29Updated last year
- DeiT implementation for Q-ViT☆24Updated 2 years ago
- LSQ+ or LSQplus☆63Updated last month
- The official implementation of the NeurIPS 2022 paper Q-ViT.☆87Updated last year
- The official PyTorch implementation of the ICLR2022 paper, QDrop: Randomly Dropping Quantization for Extremely Low-bit Post-Training Quan…☆115Updated last year
- [HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning☆83Updated 6 months ago
- ☆23Updated this week
- Official implementation of EMNLP'23 paper "Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference?"☆19Updated last year
- [TCAD'23] AccelTran: A Sparsity-Aware Accelerator for Transformers☆38Updated last year
- A co-design architecture on sparse attention☆50Updated 3 years ago
- ☆22Updated last year
- ☆75Updated 2 years ago
- This is a repository of Binary General Matrix Multiply (BGEMM) by customized CUDA kernel. Thank FP6-LLM for the wheels!☆14Updated 6 months ago
- ☆43Updated 3 years ago
- Tender: Accelerating Large Language Models via Tensor Decompostion and Runtime Requantization (ISCA'24)☆13Updated 8 months ago
- ViTALiTy (HPCA'23) Code Repository☆21Updated 2 years ago
- ☆141Updated 2 years ago
- [ICML 2023] This project is the official implementation of our accepted ICML 2023 paper BiBench: Benchmarking and Analyzing Network Binar…☆55Updated last year
- Edge-MoE: Memory-Efficient Multi-Task Vision Transformer Architecture with Task-level Sparsity via Mixture-of-Experts☆108Updated 10 months ago
- [TMLR] Official PyTorch implementation of paper "Quantization Variation: A New Perspective on Training Transformers with Low-Bit Precisio…☆42Updated 5 months ago
- ☆23Updated 3 months ago
- ☆52Updated 11 months ago
- BSQ: Exploring Bit-Level Sparsity for Mixed-Precision Neural Network Quantization (ICLR 2021)☆40Updated 4 years ago
- Torch2Chip (MLSys, 2024)☆51Updated this week
- ☆39Updated last year
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆289Updated 10 months ago