openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,111Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆780Updated last month
- Convert ONNX models to PyTorch.☆716Updated 2 months ago
- A parser, editor and profiler tool for ONNX models.☆469Updated last month
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,544Updated last week
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,521Updated this week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆428Updated this week
- ☆339Updated 2 years ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,588Updated last month
- Model Quantization Benchmark☆854Updated 8 months ago
- Common utilities for ONNX converters☆289Updated last week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆861Updated 4 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,907Updated this week
- Transform ONNX model to PyTorch representation☆345Updated last month
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,681Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆518Updated this week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆431Updated this week
- TensorRT Plugin Autogen Tool☆367Updated 2 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,175Updated last month
- Simplify your onnx model☆4,253Updated 3 months ago
- Deploy your model with TensorRT quickly.☆764Updated 2 years ago
- ⚡ Useful scripts when using TensorRT☆237Updated 5 years ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆955Updated 8 months ago
- A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.☆358Updated last year
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆301Updated last year
- A scalable inference server for models optimized with OpenVINO™☆804Updated this week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆894Updated last week
- ppl.cv is a high-performance image processing library of openPPL supporting various platforms.☆513Updated last year
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆414Updated this week
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆731Updated last month
- Tensorflow Backend for ONNX☆1,327Updated last year