openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,113Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆787Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,565Updated this week
- Convert ONNX models to PyTorch.☆719Updated 2 months ago
- A parser, editor and profiler tool for ONNX models.☆471Updated 2 months ago
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,530Updated this week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆428Updated last week
- Common utilities for ONNX converters☆290Updated 3 weeks ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,599Updated last month
- Transform ONNX model to PyTorch representation☆344Updated 2 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,917Updated this week
- ☆340Updated 2 years ago
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆862Updated 2 weeks ago
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆415Updated this week
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,770Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆527Updated this week
- Model Quantization Benchmark☆855Updated 8 months ago
- OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models☆33Updated 3 months ago
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,211Updated this week
- ⚡ Useful scripts when using TensorRT☆237Updated 5 years ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆433Updated 3 weeks ago
- Deploy your model with TensorRT quickly.☆765Updated 2 years ago
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆303Updated last year
- A scalable inference server for models optimized with OpenVINO™☆809Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,175Updated 2 months ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,002Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆502Updated last week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,939Updated 2 years ago
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆902Updated 2 weeks ago
- This script converts the ONNX/OpenVINO IR model to Tensorflow's saved_model, tflite, h5, tfjs, tftrt(TensorRT), CoreML, EdgeTPU, ONNX and…☆345Updated 3 years ago
- Tensorflow Backend for ONNX☆1,325Updated last year