openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,098Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆770Updated last week
- Common utilities for ONNX converters☆283Updated 2 months ago
- A parser, editor and profiler tool for ONNX models.☆462Updated last week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆424Updated this week
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,492Updated this week
- Convert ONNX models to PyTorch.☆707Updated 3 weeks ago
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, …☆2,520Updated this week
- Transform ONNX model to PyTorch representation☆342Updated last week
- ☆338Updated last year
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,572Updated 8 months ago
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,512Updated this week
- Model Quantization Benchmark☆847Updated 6 months ago
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆409Updated this week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆854Updated 2 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,878Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆505Updated this week
- A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.☆360Updated last year
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆451Updated 2 years ago
- OTOv1-v3, NeurIPS, ICLR, TMLR, DNN Training, Compression, Structured Pruning, Erasing Operators, CNN, Diffusion, LLM☆309Updated last year
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆424Updated this week
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆953Updated 7 months ago
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆298Updated last year
- ⚡ Useful scripts when using TensorRT☆239Updated 5 years ago
- OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models☆33Updated last month
- Brevitas: neural network quantization in PyTorch☆1,422Updated this week
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆537Updated last year
- Simplify your onnx model☆4,222Updated 2 months ago
- Deploy your model with TensorRT quickly.☆765Updated last year
- Tensorflow Backend for ONNX☆1,325Updated last year
- TensorRT Plugin Autogen Tool☆368Updated 2 years ago