openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,046Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆721Updated last week
- A parser, editor and profiler tool for ONNX models.☆442Updated last week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,430Updated this week
- Common utilities for ONNX converters☆272Updated 6 months ago
- Model Quantization Benchmark☆814Updated 2 months ago
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,340Updated this week
- Tools for easier OpenVINO development/debugging☆9Updated 3 months ago
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆995Updated this week
- ☆326Updated last year
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆469Updated last week
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,517Updated 3 months ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆392Updated 2 weeks ago
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆293Updated this week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆400Updated this week
- Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…☆718Updated last week
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆358Updated this week
- Transform ONNX model to PyTorch representation☆338Updated 7 months ago
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆989Updated 9 months ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆439Updated 2 years ago
- Convert ONNX models to PyTorch.☆680Updated 10 months ago
- Simplify your onnx model☆4,096Updated 9 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,783Updated this week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆811Updated 3 weeks ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆948Updated 2 months ago
- Tensorflow Backend for ONNX☆1,310Updated last year
- ONNX-TensorRT: TensorRT backend for ONNX☆3,094Updated this week
- A DNN inference latency prediction toolkit for accurately modeling and predicting the latency on diverse edge devices.☆354Updated 10 months ago
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆295Updated last year
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,920Updated last year
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆831Updated 3 weeks ago