quic / aimet
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,293Updated this week
Alternatives and similar repositories for aimet:
Users that are interested in aimet are comparing it to the libraries listed below
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,913Updated last year
- ☆321Updated last year
- Simplify your onnx model☆4,065Updated 8 months ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,005Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,742Updated this week
- ONNX Optimizer☆700Updated last week
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆942Updated 3 weeks ago
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,084Updated 2 months ago
- Model Quantization Benchmark☆801Updated 2 weeks ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,387Updated last week
- Neural Network Distiller by Intel AI Lab: a Python package for neural network compression research. https://intellabs.github.io/distille…☆4,390Updated 2 years ago
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,011Updated this week
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,540Updated 5 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,065Updated 2 months ago
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆823Updated last month
- An easy to use PyTorch to TensorRT converter☆4,729Updated 8 months ago
- Mobile vision models and code☆912Updated last month
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,315Updated this week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,414Updated 3 months ago
- Collection of recent methods on (deep) neural network compression and acceleration.☆946Updated last month
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,482Updated 2 months ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,042Updated last year
- Low-precision matrix multiplication☆1,802Updated last year
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,381Updated this week
- [CVPR 2023] DepGraph: Towards Any Structural Pruning; LLMs, Vision Foundation Models, etc.☆2,994Updated 2 weeks ago
- Tensorflow Backend for ONNX☆1,301Updated last year
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,686Updated last year
- [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models☆1,399Updated 9 months ago
- A parser, editor and profiler tool for ONNX models.☆430Updated 3 months ago
- Reference implementations of MLPerf™ inference benchmarks☆1,369Updated this week