Zhen-Dong / Awesome-Quantization-Papers
List of papers related to neural network quantization in recent AI conferences and journals.
☆459Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for Awesome-Quantization-Papers
- ☆169Updated 3 months ago
- Awesome LLM compression research papers and tools.☆1,205Updated this week
- Awesome list for LLM pruning.☆169Updated this week
- ☆289Updated 7 months ago
- Code for Neurips24 paper: QuaRot, an end-to-end 4-bit inference of large language models.☆288Updated 4 months ago
- Awasome Papers and Resources in Deep Neural Network Pruning with Source Code.☆134Updated 2 months ago
- Awesome LLM pruning papers all-in-one repository with integrating all useful resources and insights.☆38Updated last week
- QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving☆446Updated last week
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,258Updated 4 months ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆1,887Updated 3 weeks ago
- A list of papers, docs, codes about efficient AIGC. This repo is aimed to provide the info for efficient AIGC research, including languag…☆154Updated 3 weeks ago
- ☆195Updated 3 years ago
- This repository contains integer operators on GPUs for PyTorch.☆183Updated last year
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆308Updated last year
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆104Updated last year
- Post-Training Quantization for Vision transformers.☆190Updated 2 years ago
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆324Updated this week
- Code repo for the paper "LLM-QAT Data-Free Quantization Aware Training for Large Language Models"☆254Updated 2 months ago
- All Homeworks for TinyML and Efficient Deep Learning Computing 6.5940 • Fall • 2023 • https://efficientml.ai☆137Updated 11 months ago
- [NeurIPS 2022] A Fast Post-Training Pruning Framework for Transformers☆171Updated last year
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆413Updated last year
- 📰 Must-read papers and blogs on Speculative Decoding ⚡️☆473Updated this week
- Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline mod…☆312Updated 2 months ago
- Pytorch implementation of BRECQ, ICLR 2021☆254Updated 3 years ago
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,025Updated last week
- A curated list for Efficient Large Language Models☆1,280Updated this week
- Code Repository of Evaluating Quantized Large Language Models☆103Updated 2 months ago
- TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillati…☆573Updated this week
- Code repo for the paper "SpinQuant LLM quantization with learned rotations"☆164Updated last week
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆491Updated 2 months ago