quic / aimetLinks
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,504Updated last week
Alternatives and similar repositories for aimet
Users that are interested in aimet are comparing it to the libraries listed below
Sorting:
- ☆338Updated 2 years ago
- Simplify your onnx model☆4,234Updated 3 months ago
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,533Updated last week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,939Updated last year
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆857Updated 3 months ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,109Updated this week
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,580Updated last week
- ONNX Optimizer☆780Updated last month
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,894Updated this week
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,280Updated 8 months ago
- Tensorflow Backend for ONNX☆1,326Updated last year
- ONNX-TensorRT: TensorRT backend for ONNX☆3,172Updated 3 weeks ago
- A parser, editor and profiler tool for ONNX models.☆468Updated 3 weeks ago
- Model Quantization Benchmark☆850Updated 7 months ago
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,184Updated this week
- Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…☆4,400Updated 2 years ago
- ☆1,023Updated 2 years ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,558Updated last week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,499Updated 2 months ago
- [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep L…☆908Updated last year
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,578Updated this week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆883Updated last week
- A curated list of neural network pruning resources.☆2,483Updated last year
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆541Updated last year
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆954Updated 7 months ago
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,562Updated last year
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.☆3,195Updated 2 months ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆953Updated 7 months ago
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,547Updated 6 years ago
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆425Updated last week