microsoft / nn-Meter
A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
☆336Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for nn-Meter
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆369Updated 3 years ago
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆274Updated 11 months ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆413Updated last year
- Model Quantization Benchmark☆762Updated 5 months ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆194Updated 2 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆258Updated last year
- Pytorch implementation of BRECQ, ICLR 2021☆250Updated 3 years ago
- Quantization of Convolutional Neural networks.☆239Updated 3 months ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆201Updated last year
- PyTorch implementation for the APoT quantization (ICLR 2020)☆267Updated 2 years ago
- ☆214Updated 2 years ago
- Measuring and predicting on-device metrics (latency, power, etc.) of machine learning models☆66Updated last year
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆486Updated last month
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆156Updated 4 years ago
- [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices☆428Updated 11 months ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆103Updated last year
- Inference of quantization aware trained networks using TensorRT☆78Updated last year
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆275Updated 6 months ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆157Updated 3 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆95Updated 3 years ago
- ☆223Updated 3 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆960Updated last month
- The Tensor Algebra SuperOptimizer for Deep Learning☆691Updated last year
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆95Updated 2 years ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆392Updated last year
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆202Updated 3 years ago
- ☆298Updated 11 months ago
- A parser, editor and profiler tool for ONNX models.☆397Updated last month
- ☆121Updated last year
- ☆376Updated 2 years ago