openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,075Updated last week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆752Updated last month
- A parser, editor and profiler tool for ONNX models.☆454Updated last month
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,491Updated this week
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,443Updated this week
- Common utilities for ONNX converters☆279Updated last week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆414Updated 2 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,848Updated this week
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,553Updated 6 months ago
- Model Quantization Benchmark☆833Updated 4 months ago
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,200Updated this week
- ☆334Updated last year
- OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models☆32Updated 5 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆488Updated this week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆409Updated this week
- Transform ONNX model to PyTorch representation☆339Updated 9 months ago
- Convert ONNX models to PyTorch.☆698Updated last year
- A scalable inference server for models optimized with OpenVINO™☆757Updated this week
- TensorRT Plugin Autogen Tool☆367Updated 2 years ago
- ⚡ Useful scripts when using TensorRT☆239Updated 5 years ago
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆378Updated this week
- TensorFlow/TensorRT integration☆744Updated last year
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,202Updated this week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆843Updated 3 weeks ago
- Deploy your model with TensorRT quickly.☆768Updated last year
- ONNX-TensorRT: TensorRT backend for ONNX☆3,149Updated last month
- Inference of quantization aware trained networks using TensorRT☆83Updated 2 years ago
- Conversion of PyTorch Models into TFLite☆390Updated 2 years ago
- Simplify your onnx model☆4,165Updated 2 weeks ago
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆850Updated last month
- This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and…☆343Updated 2 years ago