quic / aimetLinks
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,544Updated this week
Alternatives and similar repositories for aimet
Users that are interested in aimet are comparing it to the libraries listed below
Sorting:
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,928Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,574Updated this week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,119Updated last week
- ☆340Updated 2 years ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,939Updated 2 years ago
- Simplify your onnx model☆4,280Updated this week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆862Updated last month
- ONNX Optimizer☆793Updated last week
- Tensorflow Backend for ONNX☆1,325Updated last year
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,602Updated 2 months ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,510Updated 4 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,116Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆3,180Updated 2 months ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,314Updated 10 months ago
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,848Updated last week
- Model Quantization Benchmark☆855Updated 9 months ago
- A parser, editor and profiler tool for ONNX models.☆475Updated 2 months ago
- Reference implementations of MLPerf® inference benchmarks☆1,518Updated this week
- An easy to use PyTorch to TensorRT converter☆4,845Updated last year
- ☆1,068Updated 2 years ago
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,237Updated this week
- Transformer related optimization, including BERT, GPT☆6,384Updated last year
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,562Updated this week
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,590Updated last year
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,777Updated last year
- Brevitas: neural network quantization in PyTorch☆1,477Updated this week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆911Updated this week
- Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…☆432Updated this week
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,645Updated 2 months ago
- Convert ONNX models to PyTorch.☆724Updated 3 months ago