NVIDIA / sampleQAT
Inference of quantization aware trained networks using TensorRT
☆80Updated 2 years ago
Alternatives and similar repositories for sampleQAT:
Users that are interested in sampleQAT are comparing it to the libraries listed below
- ☆69Updated 2 years ago
- PyTorch Quantization Aware Training Example☆131Updated 10 months ago
- Count number of parameters / MACs / FLOPS for ONNX models.☆89Updated 4 months ago
- FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch☆33Updated 3 years ago
- Benchmark scripts for TVM☆73Updated 3 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆260Updated last year
- Offline Quantization Tools for Deploy.☆125Updated last year
- Benchmark of TVM quantized model on CUDA☆111Updated 4 years ago
- A code generator from ONNX to PyTorch code☆135Updated 2 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆96Updated 3 years ago
- tophub autotvm log collections☆70Updated 2 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆197Updated 2 years ago
- ☆141Updated 2 years ago
- symmetric int8 gemm☆66Updated 4 years ago
- PyTorch Static Quantization Example☆38Updated 3 years ago
- NART = NART is not A RunTime, a deep learning inference framework.☆38Updated 2 years ago
- A sample for onnxparser working with trt user defined plugins for TRT7.0☆166Updated 4 years ago
- MegEngine到其他框架的转换器☆69Updated last year
- System for automated integration of deep learning backends.☆48Updated 2 years ago
- A set of examples around MegEngine☆31Updated last year
- Scailable ONNX python tools☆97Updated 4 months ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆94Updated 2 years ago
- Manually implemented quantization-aware training☆21Updated 2 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆269Updated 3 years ago
- ☆37Updated 2 years ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆203Updated 4 years ago
- quantize aware training package for NCNN on pytorch☆70Updated 3 years ago
- This repository contains the results and code for the MLPerf™ Inference v0.5 benchmark.☆55Updated last year
- ☆35Updated 2 years ago
- A nnie quantization aware training tool on pytorch.☆239Updated 4 years ago