openvinotoolkit / nncfLinks
Neural Network Compression Framework for enhanced OpenVINO™ inference
☆1,034Updated this week
Alternatives and similar repositories for nncf
Users that are interested in nncf are comparing it to the libraries listed below
Sorting:
- ONNX Optimizer☆715Updated this week
- A parser, editor and profiler tool for ONNX models.☆436Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,419Updated this week
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,318Updated this week
- Common utilities for ONNX converters☆270Updated 5 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,762Updated this week
- Tools for easier OpenVINO development/debugging☆9Updated 2 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,506Updated 3 months ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆466Updated this week
- Model Quantization Benchmark☆804Updated last month
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆397Updated this week
- ⚡ Useful scripts when using TensorRT☆242Updated 4 years ago
- ☆324Updated last year
- OpenVINO™ Explainable AI (XAI) Toolkit: Visual Explanation for OpenVINO Models☆32Updated 2 months ago
- PyTorch Neural Network eXchange☆587Updated 2 weeks ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆388Updated last week
- nvidia-modelopt is a unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculat…☆942Updated last week
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆354Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,079Updated 2 weeks ago
- A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…☆293Updated last year
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,916Updated last year
- Transform ONNX model to PyTorch representation☆336Updated 6 months ago
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆434Updated 2 years ago
- Simplify your onnx model☆4,088Updated 8 months ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆818Updated this week
- Examples for using ONNX Runtime for model training.☆338Updated 7 months ago
- EasyQuant(EQ) is an efficient and simple post-training quantization method via effectively optimizing the scales of weights and activatio…☆400Updated 2 years ago
- Summary, Code for Deep Neural Network Quantization☆548Updated 7 months ago
- Accelerate PyTorch models with ONNX Runtime☆361Updated 3 months ago
- A scalable inference server for models optimized with OpenVINO™☆731Updated this week