microsoft / nn-Meter
A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
☆351Updated 8 months ago
Alternatives and similar repositories for nn-Meter:
Users that are interested in nn-Meter are comparing it to the libraries listed below
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆382Updated 4 years ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆271Updated 4 months ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆431Updated last year
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆277Updated last year
- [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices☆440Updated last year
- Quantization of Convolutional Neural networks.☆244Updated 8 months ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆262Updated last year
- Model Quantization Benchmark☆799Updated this week
- Pytorch implementation of BRECQ, ICLR 2021☆272Updated 3 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆197Updated 2 years ago
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆157Updated 4 years ago
- Measuring and predicting on-device metrics (latency, power, etc.) of machine learning models☆66Updated 2 years ago
- Summary, Code for Deep Neural Network Quantization☆548Updated 6 months ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆200Updated 2 years ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆110Updated 2 years ago
- ☆229Updated 2 years ago
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆290Updated 11 months ago
- ☆225Updated 3 years ago
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆510Updated 7 months ago
- ☆143Updated 2 years ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆397Updated 2 years ago
- benchmark for embededded-ai deep learning inference engines, such as NCNN / TNN / MNN / TensorFlow Lite etc.☆204Updated 4 years ago
- A simple network quantization demo using pytorch from scratch.☆527Updated last year
- aw_nas: A Modularized and Extensible NAS Framework☆250Updated last year
- This is a list of awesome edgeAI inference related papers.☆95Updated last year
- Inference of quantization aware trained networks using TensorRT☆80Updated 2 years ago
- ☆321Updated last year
- papers about model compression☆166Updated 2 years ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆160Updated 4 years ago
- Simple Training and Deployment of Fast End-to-End Binary Networks☆157Updated 3 years ago