adreamwu / PTQ4DiT
PyTorch implementation of PTQ4DiT https://arxiv.org/abs/2405.16005
β27Updated 5 months ago
Alternatives and similar repositories for PTQ4DiT:
Users that are interested in PTQ4DiT are comparing it to the libraries listed below
- [ICLR'25] ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationβ76Updated 3 weeks ago
- QuEST: Efficient Finetuning for Low-bit Diffusion Modelsβ41Updated 2 months ago
- [NeurIPS 2024 Oralπ₯] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.β156Updated 6 months ago
- [CVPR 2025] Q-DiT: Accurate Post-Training Quantization for Diffusion Transformersβ46Updated 7 months ago
- [CVPR 2024 Highlight] This is the official PyTorch implementation of "TFMQ-DM: Temporal Feature Maintenance Quantization for Diffusion Moβ¦β62Updated 8 months ago
- [ICLR 2024 Spotlight] This is the official PyTorch implementation of "EfficientDM: Efficient Quantization-Aware Fine-Tuning of Low-Bit Diβ¦β59Updated 10 months ago
- The code repository of "MBQ: Modality-Balanced Quantization for Large Vision-Language Models"β36Updated last month
- [ICLR 2025] Mixture Compressor for Mixture-of-Experts LLMs Gains Moreβ38Updated 2 months ago
- [ECCV24] MixDQ: Memory-Efficient Few-Step Text-to-Image Diffusion Models with Metric-Decoupled Mixed Precision Quantizationβ11Updated 4 months ago
- [ICLR2025]: OSTQuant: Refining Large Language Model Quantization with Orthogonal and Scaling Transformations for Better Distribution Fittβ¦β43Updated last week
- The official implementation of PTQD: Accurate Post-Training Quantization for Diffusion Modelsβ99Updated last year
- π Collection of token reduction for model compression resources.β49Updated this week
- LLM Inference with Microscaling Formatβ20Updated 5 months ago
- An algorithm for weight-activation quantization (W4A4, W4A8) of LLMs, supporting both static and dynamic quantizationβ127Updated 2 months ago
- Learnable Semi-structured Sparsity for Vision Transformers and Diffusion Transformersβ11Updated 2 months ago
- Implementation of Post-training Quantization on Diffusion Models (CVPR 2023)β134Updated 2 years ago
- PyTorch code for our paper "ARB-LLM: Alternating Refined Binarizations for Large Language Models"β24Updated 3 weeks ago
- SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Modelsβ29Updated 8 months ago
- [NeurIPS 2024] The official implementation of ZipCache: Accurate and Efficient KV Cache Quantization with Salient Token Identificationβ19Updated 3 weeks ago
- β13Updated 3 weeks ago
- β20Updated 5 months ago
- [CVPR 2023] PD-Quant: Post-Training Quantization Based on Prediction Difference Metricβ54Updated 2 years ago
- This is the official pytorch implementation for the paper: Towards Accurate Post-training Quantization for Diffusion Models.(CVPR24 Posteβ¦β34Updated 10 months ago
- β157Updated 3 months ago
- [ECCV 2024] AdaLog: Post-Training Quantization for Vision Transformers with Adaptive Logarithm Quantizerβ25Updated 4 months ago
- XAttention: Block Sparse Attention with Antidiagonal Scoringβ140Updated 3 weeks ago
- [ICML'24 Oral] APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inferenceβ38Updated 10 months ago
- Curated list of methods that focuses on improving the efficiency of diffusion modelsβ44Updated 9 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retentiβ¦β64Updated last year
- super-resolution; post-training quantization; model compressionβ12Updated last year