NVIDIA / sampleQAT
Inference of quantization aware trained networks using TensorRT
☆80Updated 2 years ago
Alternatives and similar repositories for sampleQAT:
Users that are interested in sampleQAT are comparing it to the libraries listed below
- ☆69Updated last year
- Count number of parameters / MACs / FLOPS for ONNX models.☆90Updated 3 months ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆96Updated 3 years ago
- Offline Quantization Tools for Deploy.☆123Updated last year
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆260Updated last year
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆197Updated 2 years ago
- PyTorch Static Quantization Example☆38Updated 3 years ago
- Benchmark of TVM quantized model on CUDA☆111Updated 4 years ago
- PyTorch Quantization Aware Training Example☆128Updated 9 months ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆262Updated 3 years ago
- MegEngine到其他框架的转换器☆69Updated last year
- FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch☆33Updated 3 years ago
- NART = NART is not A RunTime, a deep learning inference framework.☆38Updated last year
- ☆44Updated 3 years ago
- A sample for onnxparser working with trt user defined plugins for TRT7.0☆166Updated 4 years ago
- tophub autotvm log collections☆70Updated 2 years ago
- Benchmark scripts for TVM☆73Updated 2 years ago
- Code for our paper at ECCV 2020: Post-Training Piecewise Linear Quantization for Deep Neural Networks☆68Updated 3 years ago
- ☆47Updated 3 years ago
- ☆220Updated 2 years ago
- Quantization of Convolutional Neural networks.☆243Updated 6 months ago
- symmetric int8 gemm☆66Updated 4 years ago
- quantize aware training package for NCNN on pytorch☆70Updated 3 years ago
- A nnie quantization aware training tool on pytorch.☆238Updated 4 years ago
- A parser, editor and profiler tool for ONNX models.☆414Updated last month
- ☆34Updated 2 years ago
- heterogeneity-aware-lowering-and-optimization☆254Updated last year
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆160Updated 4 years ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆94Updated 2 years ago