tigert1998 / qat
Manually implemented quantization-aware training
☆21Updated 2 years ago
Alternatives and similar repositories for qat:
Users that are interested in qat are comparing it to the libraries listed below
- PyTorch Quantization Aware Training Example☆131Updated 10 months ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆96Updated 3 years ago
- ☆17Updated 4 years ago
- A Winograd Minimal Filter Implementation in CUDA☆24Updated 3 years ago
- PyTorch implementation of "Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference"☆55Updated 5 years ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆94Updated 2 years ago
- ☆69Updated 2 years ago
- ☆226Updated 2 years ago
- BitSplit Post-trining Quantization☆49Updated 3 years ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆90Updated last month
- An 8bit automated quantization conversion tool for the pytorch (Post-training quantization based on KL divergence)☆33Updated 5 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆34Updated last year
- play gemm with tvm☆89Updated last year
- A Out-of-box PyTorch Scaffold for Neural Network Quantization-Aware-Training (QAT) Research. Website: https://github.com/zhutmost/neuralz…☆26Updated 2 years ago
- ☆38Updated 2 years ago
- ☆141Updated 2 years ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆160Updated 4 years ago
- Inference of quantization aware trained networks using TensorRT☆80Updated 2 years ago
- ☆202Updated 3 years ago
- FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch☆33Updated 3 years ago
- CUDA Templates for Linear Algebra Subroutines☆97Updated 11 months ago
- LSQ+ or LSQplus☆63Updated last month
- Code for our paper at ECCV 2020: Post-Training Piecewise Linear Quantization for Deep Neural Networks☆68Updated 3 years ago
- This repository containts the pytorch scripts to train mixed-precision networks for microcontroller deployment, based on the memory contr…☆49Updated 10 months ago
- [ICASSP'22] Integer-only Zero-shot Quantization for Efficient Speech Recognition☆31Updated 3 years ago
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆57Updated 6 months ago
- Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation. In CVPR 2022.☆129Updated 2 years ago
- ☆44Updated 3 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆269Updated 3 years ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆85Updated 6 years ago