quic / aimet
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,138Updated this week
Related projects ⓘ
Alternatives and complementary repositories for aimet
- ☆297Updated 11 months ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,585Updated this week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,881Updated 10 months ago
- Simplify your onnx model☆3,849Updated 2 months ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆939Updated this week
- An easy to use PyTorch to TensorRT converter☆4,599Updated 2 months ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,218Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆2,948Updated this week
- Actively maintained ONNX Optimizer☆644Updated 8 months ago
- Tensorflow Backend for ONNX☆1,285Updated 7 months ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆915Updated 3 months ago
- Reference implementations of MLPerf™ inference benchmarks☆1,226Updated this week
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,331Updated this week
- Model Quantization Benchmark☆762Updated 5 months ago
- Convert ONNX models to PyTorch.☆611Updated 2 months ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,491Updated this week
- Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…☆4,351Updated last year
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆748Updated 2 weeks ago
- Brevitas: neural network quantization in PyTorch☆1,198Updated this week
- ☆761Updated 11 months ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆1,867Updated last week
- A parser, editor and profiler tool for ONNX models.☆397Updated last month
- A curated list of neural network pruning resources.☆2,356Updated 7 months ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,320Updated 2 months ago
- [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep L…☆803Updated 4 months ago
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆423Updated last year
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,139Updated this week
- Transform ONNX model to PyTorch representation☆315Updated last month
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆8,296Updated this week
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆959Updated last month