openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,109Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆780Updated last month
- A parser, editor and profiler tool for ONNX models.☆468Updated 3 weeks ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,894Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,533Updated last week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆425Updated last week
- Convert ONNX models to PyTorch.☆710Updated last month
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆857Updated 3 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,580Updated last week
- Model Quantization Benchmark☆850Updated 7 months ago
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,504Updated last week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,172Updated 3 weeks ago
- Common utilities for ONNX converters☆285Updated 2 months ago
- ☆338Updated 2 years ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆513Updated this week
- Simplify your onnx model☆4,234Updated 3 months ago
- Transform ONNX model to PyTorch representation☆345Updated 3 weeks ago
- A scalable inference server for models optimized with OpenVINO™☆797Updated this week
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,578Updated this week
- OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models☆33Updated 2 months ago
- Deploy your model with TensorRT quickly.☆764Updated 2 years ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆429Updated this week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆883Updated last week
- TensorFlow/TensorRT integration☆744Updated 2 years ago
- ⚡ Useful scripts when using TensorRT☆237Updated 5 years ago
- Tensorflow Backend for ONNX☆1,326Updated last year
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,499Updated 2 months ago
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,205Updated this week
- TensorRT Plugin Autogen Tool☆368Updated 2 years ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆499Updated this week
- Reference implementations of MLPerf® inference benchmarks☆1,495Updated this week