NVIDIA / sampleQAT
Inference of quantization aware trained networks using TensorRT
☆78Updated last year
Related projects ⓘ
Alternatives and complementary repositories for sampleQAT
- ☆67Updated last year
- Count number of parameters / MACs / FLOPS for ONNX models.☆88Updated 2 weeks ago
- PyTorch Quantization Aware Training Example☆123Updated 5 months ago
- Benchmark of TVM quantized model on CUDA☆112Updated 4 years ago
- A code generator from ONNX to PyTorch code☆132Updated last year
- Offline Quantization Tools for Deploy.☆116Updated 10 months ago
- A sample for onnxparser working with trt user defined plugins for TRT7.0☆166Updated 4 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆258Updated last year
- Scailable ONNX python tools☆96Updated 2 weeks ago
- A parser, editor and profiler tool for ONNX models.☆397Updated last month
- NART = NART is not A RunTime, a deep learning inference framework.☆38Updated last year
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆202Updated 3 years ago
- ⚡ Useful scripts when using TensorRT☆240Updated 4 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆194Updated 2 years ago
- MegEngine到其他框架的转换器☆67Updated last year
- FakeQuantize with Learned Step Size(LSQ+) as Observer in PyTorch☆32Updated 2 years ago
- Useful tensorrt plugin. For pytorch and mmdetection model conversion.☆156Updated last month
- Benchmark scripts for TVM☆73Updated 2 years ago
- symmetric int8 gemm☆66Updated 4 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆95Updated 3 years ago
- ☆214Updated 2 years ago
- Parallel CUDA implementation of NON maximum Suppression☆77Updated 4 years ago
- Quantization of Convolutional Neural networks.☆239Updated 3 months ago
- ☆78Updated 3 years ago
- This repository contains the results and code for the MLPerf™ Inference v0.5 benchmark.☆55Updated last year
- A nnie quantization aware training tool on pytorch.☆238Updated 3 years ago
- ☆93Updated 3 years ago
- tophub autotvm log collections☆70Updated last year
- ☆121Updated last year
- heterogeneity-aware-lowering-and-optimization☆253Updated 9 months ago