microsoft / nn-Meter
A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
☆336Updated 3 months ago
Related projects ⓘ
Alternatives and complementary repositories for nn-Meter
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆370Updated 3 years ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆413Updated last year
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆274Updated 11 months ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆268Updated 2 years ago
- Model Quantization Benchmark☆765Updated 5 months ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆258Updated last year
- Pytorch implementation of BRECQ, ICLR 2021☆253Updated 3 years ago
- Quantization of Convolutional Neural networks.☆238Updated 3 months ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆104Updated last year
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆156Updated 4 years ago
- [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices☆430Updated 11 months ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆201Updated last year
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆195Updated 2 years ago
- Measuring and predicting on-device metrics (latency, power, etc.) of machine learning models☆66Updated last year
- ☆214Updated 2 years ago
- Low Precision Arithmetic Simulation in PyTorch☆265Updated 6 months ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆158Updated 3 years ago
- ☆122Updated last year
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆491Updated last month
- ☆195Updated 3 years ago
- A simple network quantization demo using pytorch from scratch.☆511Updated last year
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆203Updated 3 years ago
- ☆34Updated 2 years ago
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆277Updated 6 months ago
- Simple Training and Deployment of Fast End-to-End Binary Networks☆159Updated 2 years ago
- Inference of quantization aware trained networks using TensorRT☆79Updated last year
- aw_nas: A Modularized and Extensible NAS Framework☆246Updated last year
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆95Updated 3 years ago
- ☆302Updated 11 months ago
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆424Updated last year