quic / aimet
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,219Updated this week
Alternatives and similar repositories for aimet:
Users that are interested in aimet are comparing it to the libraries listed below
- ☆310Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,676Updated this week
- Simplify your onnx model☆3,976Updated 5 months ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,324Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,017Updated this week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,897Updated last year
- Actively maintained ONNX Optimizer☆671Updated 3 weeks ago
- Tensorflow Backend for ONNX☆1,294Updated 10 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,419Updated 2 weeks ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆1,984Updated 3 months ago
- Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…☆4,369Updated last year
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,517Updated last week
- Model Quantization Benchmark☆786Updated 3 weeks ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆971Updated this week
- Reference implementations of MLPerf™ inference benchmarks☆1,307Updated this week
- A parser, editor and profiler tool for ONNX models.☆414Updated last month
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆781Updated last month
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆2,173Updated this week
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆1,951Updated this week
- An easy to use PyTorch to TensorRT converter☆4,674Updated 6 months ago
- A curated list of neural network pruning resources.☆2,403Updated 10 months ago
- A simple network quantization demo using pytorch from scratch.☆521Updated last year
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,276Updated this week
- Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.☆425Updated last year
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,620Updated 10 months ago
- Mobile vision models and code☆908Updated last week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,368Updated 2 weeks ago
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆4,596Updated 2 months ago
- Low-precision matrix multiplication☆1,790Updated last year
- PyTorch library to facilitate development and standardized evaluation of neural network pruning methods.☆428Updated last year