Zhen-Dong / Awesome-Quantization-Papers
List of papers related to neural network quantization in recent AI conferences and journals.
☆597Updated 3 weeks ago
Alternatives and similar repositories for Awesome-Quantization-Papers:
Users that are interested in Awesome-Quantization-Papers are comparing it to the libraries listed below
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,063Updated last month
- ☆236Updated 8 months ago
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆165Updated last year
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,140Updated 3 weeks ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆376Updated 4 months ago
- ☆203Updated 3 years ago
- A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including languag…☆177Updated 2 months ago
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆259Updated 2 months ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,392Updated 9 months ago
- Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.☆156Updated 7 months ago
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆333Updated 2 years ago
- Awesome list for LLM pruning.☆222Updated 4 months ago
- Awesome LLM compression research papers and tools.☆1,472Updated last week
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆510Updated 7 months ago
- Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"☆280Updated last month
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆461Updated this week
- [MLSys'25] QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving; [MLSys'25] LServe: Efficient Long-sequence LLM Se…☆643Updated last month
- This repository contains integer operators on GPUs for PyTorch.☆202Updated last year
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆431Updated last year
- ☆313Updated last year
- A curated list for Efficient Large Language Models☆1,614Updated last week
- Model Quantization Benchmark☆799Updated this week
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆118Updated last year
- Awesome list for LLM quantization☆201Updated 4 months ago
- Post-Training Quantization for Vision transformers.☆215Updated 2 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆272Updated 3 years ago
- BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.☆594Updated 2 months ago
- Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".☆785Updated 8 months ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆185Updated 2 years ago
- [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.☆800Updated 6 months ago