openvinotoolkit / nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆986Updated this week
Alternatives and similar repositories for nncf:
Users that are interested in nncf are comparing it to the libraries listed below
- ONNX Optimizer☆681Updated this week
- A parser, editor and profiler tool for ONNX models.☆421Updated 2 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,446Updated 3 weeks ago
- Common utilities for ONNX converters☆259Updated 3 months ago
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,249Updated last week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆373Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,355Updated this week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆366Updated this week
- A unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillation, speculative decoding, et…☆808Updated this week
- Model Quantization Benchmark☆793Updated 2 months ago
- ☆314Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,711Updated this week
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,161Updated this week
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆830Updated this week
- Simplify your onnx model☆4,002Updated 6 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆449Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,044Updated 2 weeks ago
- Deploy your model with TensorRT quickly.☆765Updated last year
- Transform ONNX model to PyTorch representation☆328Updated 4 months ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆236Updated this week
- OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models☆32Updated last week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆767Updated this week
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆323Updated this week
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆428Updated last year
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆290Updated 10 months ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆979Updated 6 months ago
- This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and…☆340Updated 2 years ago
- A scalable inference server for models optimized with OpenVINO™☆714Updated this week
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- TensorRT Plugin Autogen Tool☆369Updated last year