quic / aimetLinks
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,552Updated this week
Alternatives and similar repositories for aimet
Users that are interested in aimet are comparing it to the libraries listed below
Sorting:
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,939Updated last week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,581Updated this week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,123Updated last week
- ☆342Updated 2 years ago
- Simplify your onnx model☆4,288Updated last week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,939Updated 2 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,184Updated last week
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,321Updated last week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆863Updated last month
- ONNX Optimizer☆795Updated last week
- Model Quantization Benchmark☆857Updated 9 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,606Updated 2 months ago
- An easy to use PyTorch to TensorRT converter☆4,853Updated last year
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,964Updated this week
- Reference implementations of MLPerf® inference benchmarks☆1,525Updated this week
- A parser, editor and profiler tool for ONNX models.☆480Updated 3 months ago
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,245Updated this week
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,781Updated last year
- Tensorflow Backend for ONNX☆1,326Updated last year
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,647Updated 2 weeks ago
- Brevitas: neural network quantization in PyTorch☆1,482Updated last week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,514Updated 4 months ago
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆956Updated 10 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,152Updated this week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆432Updated this week
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,550Updated 6 years ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,562Updated this week
- ☆1,073Updated 2 years ago
- [NeurIPS 2020] MCUNet: Tiny Deep Learning on IoT Devices; [NeurIPS 2021] MCUNetV2: Memory-Efficient Patch-based Inference for Tiny Deep L…☆922Updated last year
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,607Updated last year