microsoft / nn-Meter
A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
☆350Updated 9 months ago
Alternatives and similar repositories for nn-Meter
Users that are interested in nn-Meter are comparing it to the libraries listed below
Sorting:
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆432Updated 2 years ago
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆384Updated 4 years ago
- Quantization of Convolutional Neural networks.☆244Updated 9 months ago
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆157Updated 4 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆199Updated 3 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆272Updated 3 years ago
- Model Quantization Benchmark☆803Updated 3 weeks ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆273Updated 5 months ago
- Measuring and predicting on-device metrics (latency, power, etc.) of machine learning models☆66Updated 2 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆262Updated last year
- ☆36Updated 2 years ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆110Updated 2 years ago
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆200Updated 2 years ago
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆278Updated last year
- [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices☆441Updated last year
- A parser, editor and profiler tool for ONNX models.☆431Updated 4 months ago
- ☆146Updated 2 years ago
- Inference of quantization aware trained networks using TensorRT☆80Updated 2 years ago
- Code for our paper at ECCV 2020: Post-Training Piecewise Linear Quantization for Deep Neural Networks☆69Updated 3 years ago
- Simple Training and Deployment of Fast End-to-End Binary Networks☆157Updated 3 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆96Updated 3 years ago
- ☆230Updated 2 years ago
- aw_nas: A Modularized and Extensible NAS Framework☆250Updated last year
- Code for the NeurIPS 2022 paper "Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruning".☆119Updated last year
- This is a list of awesome edgeAI inference related papers.☆96Updated last year
- ☆225Updated 3 years ago
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆291Updated last year
- Low Precision Arithmetic Simulation in PyTorch☆277Updated 11 months ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆94Updated 3 years ago
- Reference implementations of popular Binarized Neural Networks☆107Updated last month