Zhen-Dong / Awesome-Quantization-Papers
List of papers related to neural network quantization in recent AI conferences and journals.
☆618Updated last month
Alternatives and similar repositories for Awesome-Quantization-Papers
Users that are interested in Awesome-Quantization-Papers are comparing it to the libraries listed below
Sorting:
- ☆245Updated 8 months ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,093Updated 2 months ago
- Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.☆159Updated 8 months ago
- Awesome LLM compression research papers and tools.☆1,502Updated last week
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆338Updated 2 years ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,401Updated 10 months ago
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆169Updated last year
- A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including languag…☆180Updated 3 months ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆384Updated 5 months ago
- ☆204Updated 3 years ago
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…☆666Updated 2 months ago
- Pytorch implementation of BRECQ, ICLR 2021☆272Updated 3 years ago
- Post-Training Quantization for Vision transformers.☆216Updated 2 years ago
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆517Updated 7 months ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆432Updated 2 years ago
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆454Updated 8 months ago
- This repository contains integer operators on GPUs for PyTorch.☆204Updated last year
- Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"☆284Updated 2 months ago
- Awesome list for LLM quantization☆213Updated 4 months ago
- Awesome list for LLM pruning.☆224Updated 5 months ago
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆272Updated 3 months ago
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆473Updated this week
- nvidia-modelopt is a unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculat…☆909Updated last week
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆189Updated 2 years ago
- A curated list for Efficient Large Language Models☆1,651Updated 3 weeks ago
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆725Updated last week
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆119Updated last year
- Model Quantization Benchmark☆803Updated 3 weeks ago
- ☆230Updated 2 years ago
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,151Updated last month