NVIDIA / sampleQAT
Inference of quantization aware trained networks using TensorRT
☆80Updated 2 years ago
Alternatives and similar repositories for sampleQAT:
Users that are interested in sampleQAT are comparing it to the libraries listed below
- PyTorch Quantization Aware Training Example☆135Updated 11 months ago
- ☆69Updated 2 years ago
- Count number of parameters / MACs / FLOPS for ONNX models.☆91Updated 5 months ago
- FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch☆33Updated 3 years ago
- Offline Quantization Tools for Deploy.☆126Updated last year
- Benchmark scripts for TVM☆74Updated 3 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆95Updated 3 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆262Updated last year
- PyTorch Static Quantization Example☆38Updated 3 years ago
- A sample for onnxparser working with trt user defined plugins for TRT7.0☆167Updated 4 years ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- ☆229Updated 2 years ago
- MegEngine到其他框架的转换器☆69Updated last year
- tophub autotvm log collections☆69Updated 2 years ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆94Updated 2 years ago
- Benchmark of TVM quantized model on CUDA☆111Updated 4 years ago
- ☆44Updated 3 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆197Updated 2 years ago
- quantize aware training package for NCNN on pytorch☆70Updated 3 years ago
- Code for our paper at ECCV 2020: Post-Training Piecewise Linear Quantization for Deep Neural Networks☆69Updated 3 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆271Updated 3 years ago
- A code generator from ONNX to PyTorch code☆136Updated 2 years ago
- ☆38Updated 3 years ago
- NART = NART is not A RunTime, a deep learning inference framework.☆38Updated 2 years ago
- ☆142Updated 2 years ago
- symmetric int8 gemm☆67Updated 4 years ago
- ☆80Updated 4 years ago
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- Quantization of Convolutional Neural networks.☆244Updated 8 months ago
- A nnie quantization aware training tool on pytorch.☆239Updated 4 years ago