openvinotoolkit / nncf
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,005Updated this week
Alternatives and similar repositories for nncf:
Users that are interested in nncf are comparing it to the libraries listed below
- ONNX Optimizer☆700Updated this week
- A parser, editor and profiler tool for ONNX models.☆430Updated 3 months ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,387Updated last week
- Common utilities for ONNX converters☆268Updated 5 months ago
- Convert ONNX models to PyTorch.☆666Updated 8 months ago
- Model Quantization Benchmark☆801Updated 2 weeks ago
- Transform ONNX model to PyTorch representation☆332Updated 5 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,482Updated 2 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,742Updated this week
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,293Updated this week
- Simplify your onnx model☆4,065Updated 8 months ago
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆391Updated this week
- ☆321Updated last year
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆460Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,065Updated 2 months ago
- Deploy your model with TensorRT quickly.☆769Updated last year
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆789Updated 3 weeks ago
- nvidia-modelopt is a unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculat…☆900Updated last week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆380Updated this week
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆292Updated last year
- Tools for easier OpenVINO development/debugging☆10Updated last month
- A code generator from ONNX to PyTorch code☆136Updated 2 years ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆942Updated 3 weeks ago
- Tensorflow Backend for ONNX☆1,301Updated last year
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆474Updated 2 weeks ago
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆850Updated this week
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆348Updated this week
- A simple network quantization demo using pytorch from scratch.☆528Updated last year
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆823Updated last month