microsoft / nn-MeterLinks
A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.
☆363Updated last year
Alternatives and similar repositories for nn-Meter
Users that are interested in nn-Meter are comparing it to the libraries listed below
Sorting:
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆453Updated 2 years ago
- [CVPR 2019, Oral] HAQ: Hardware-Aware Automated Quantization with Mixed Precision☆400Updated 4 years ago
- [CVPR'20] ZeroQ: A Novel Zero Shot Quantization Framework☆280Updated 2 years ago
- [MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration☆200Updated 3 years ago
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆264Updated 2 years ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆281Updated last year
- ☆244Updated 3 years ago
- Quantization of Convolutional Neural networks.☆250Updated last year
- ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training☆198Updated 3 years ago
- Pytorch implementation of BRECQ, ICLR 2021☆287Updated 4 years ago
- ☆37Updated 3 years ago
- [ECCV 2018] AMC: AutoML for Model Compression and Acceleration on Mobile Devices☆449Updated 2 years ago
- Improving Post Training Neural Quantization: Layer-wise Calibration and Integer Programming☆98Updated 4 years ago
- Model Quantization Benchmark☆855Updated 9 months ago
- [ICLR 2021] HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark☆114Updated 2 years ago
- Neural Network Quantization & Low-Bit Fixed Point Training For Hardware-Friendly Algorithm Design☆160Updated 5 years ago
- ☆169Updated 2 years ago
- Inference of quantization aware trained networks using TensorRT☆83Updated 2 years ago
- Summary, Code for Deep Neural Network Quantization☆559Updated 7 months ago
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆159Updated 5 years ago
- aw_nas: A Modularized and Extensible NAS Framework☆252Updated last month
- ☆78Updated 2 years ago
- A simple network quantization demo using pytorch from scratch.☆543Updated 2 years ago
- [ICLR 2022 Oral] F8Net: Fixed-Point 8-bit Only Multiplication for Network Quantization☆93Updated 3 years ago
- This is a list of awesome edgeAI inference related papers.☆98Updated 2 years ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆1,005Updated last year
- ☆208Updated 4 years ago
- Unofficial implementation of LSQ-Net, a neural network quantization framework☆309Updated last year
- ☆230Updated 4 years ago
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆355Updated 2 years ago