Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,127Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,563Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,590Updated this week
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,216Updated this week
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆9,737Updated this week
- micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantiz…☆2,271May 6, 2025Updated 9 months ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆440Updated this week
- PyTorch implementation of Data Free Quantization Through Weight Equalization and Bias Correction.☆263Oct 3, 2023Updated 2 years ago
- Model Quantization Benchmark☆858Apr 20, 2025Updated 10 months ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆453May 15, 2023Updated 2 years ago
- Pre-trained Deep Learning models and demos (high quality and extremely fast)☆4,357Feb 20, 2026Updated last week
- Simplify your onnx model☆4,297Updated this week
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.☆3,258Sep 7, 2025Updated 5 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆537Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,947Updated this week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆866Dec 24, 2025Updated 2 months ago
- Repository for OpenVINO's extra modules☆164Feb 20, 2026Updated last week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,940Dec 14, 2023Updated 2 years ago
- 📚 Jupyter notebook tutorials for OpenVINO™☆3,046Feb 15, 2026Updated last week
- Brevitas: neural network quantization in PyTorch☆1,488Updated this week
- ONNX Optimizer☆797Feb 4, 2026Updated 3 weeks ago
- [CVPR 2020] APQ: Joint Search for Network Architecture, Pruning and Quantization Policy☆160Jun 16, 2020Updated 5 years ago
- Mobile vision models and code☆917Feb 11, 2026Updated 2 weeks ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,327Jan 29, 2026Updated last month
- A nnie quantization aware training tool on pytorch.☆237Dec 10, 2020Updated 5 years ago
- PyTorch implementation for the APoT quantization (ICLR 2020)☆283Dec 11, 2024Updated last year
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,723Updated this week
- ☆21Jul 3, 2024Updated last year
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,785Mar 28, 2024Updated last year
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆408Nov 22, 2022Updated 3 years ago
- Open Machine Learning Compiler Framework☆13,142Updated this week
- ☆79Jul 21, 2022Updated 3 years ago
- Tengine is a lite, high performance, modular inference engine for embedded device☆4,506Mar 6, 2025Updated 11 months ago
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,662Jun 11, 2024Updated last year
- A scalable inference server for models optimized with OpenVINO™☆833Updated this week
- [IJCAI 2022] FQ-ViT: Post-Training Quantization for Fully Quantized Vision Transformer☆360Apr 11, 2023Updated 2 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,188Feb 3, 2026Updated 3 weeks ago
- MPLSandbox is an out-of-the-box multi-programming language sandbox designed to provide unified and comprehensive feedback from compiler a…☆180Apr 15, 2025Updated 10 months ago
- Slimmable Networks, AutoSlim, and Beyond, ICLR 2019, and ICCV 2019☆928Mar 9, 2023Updated 2 years ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,012Feb 13, 2026Updated 2 weeks ago