quic / aimetLinks
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,519Updated this week
Alternatives and similar repositories for aimet
Users that are interested in aimet are comparing it to the libraries listed below
Sorting:
- ☆339Updated 2 years ago
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,543Updated this week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,109Updated this week
- Simplify your onnx model☆4,240Updated 3 months ago
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,941Updated 2 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,904Updated this week
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆860Updated 3 months ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,287Updated 9 months ago
- ONNX Optimizer☆781Updated last month
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,583Updated 3 weeks ago
- Model Quantization Benchmark☆853Updated 7 months ago
- Tensorflow Backend for ONNX☆1,327Updated last year
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,187Updated last week
- ☆1,034Updated 2 years ago
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆892Updated 2 weeks ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,175Updated last month
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,500Updated 3 months ago
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,637Updated this week
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,570Updated last year
- A curated list of neural network pruning resources.☆2,484Updated last year
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,772Updated last year
- Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…☆4,397Updated 2 years ago
- A parser, editor and profiler tool for ONNX models.☆469Updated last month
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆2,993Updated this week
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆954Updated 8 months ago
- A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.☆1,559Updated this week
- Reference implementations of MLPerf® inference benchmarks☆1,500Updated last week
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods p…☆1,573Updated 3 weeks ago
- Awesome machine learning model compression research papers, quantization, tools, and learning material.☆540Updated last year
- Collection of recent methods on (deep) neural network compression and acceleration.☆953Updated 8 months ago