quic / aimetLinks
AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.
☆2,552Updated this week
Alternatives and similar repositories for aimet
Users that are interested in aimet are comparing it to the libraries listed below
Sorting:
- Simplify your onnx model☆4,288Updated last week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,581Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,939Updated this week
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,939Updated 2 years ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,606Updated 2 months ago
- ☆342Updated 2 years ago
- ONNX Optimizer☆795Updated this week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,123Updated this week
- Model Quantization Benchmark☆857Updated 9 months ago
- TinyNeuralNetwork is an efficient and easy-to-use deep learning model compression framework.☆863Updated last month
- ONNX-TensorRT: TensorRT backend for ONNX☆3,184Updated last week
- A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are co…☆2,321Updated last week
- Tensorflow Backend for ONNX☆1,326Updated last year
- Reference implementations of MLPerf® inference benchmarks☆1,525Updated this week
- A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…☆1,925Updated last week
- A parser, editor and profiler tool for ONNX models.☆478Updated 3 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,152Updated this week
- ☆1,073Updated 2 years ago
- PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.☆1,781Updated last year
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,245Updated this week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,514Updated 4 months ago
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,647Updated 2 weeks ago
- Brevitas: neural network quantization in PyTorch☆1,482Updated last week
- FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/☆1,525Updated this week
- Bolt is a deep learning library with high performance and heterogeneous flexibility.☆956Updated 9 months ago
- Transformer related optimization, including BERT, GPT☆6,392Updated last year
- Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators☆1,550Updated 6 years ago
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆923Updated this week
- Transform ONNX model to PyTorch representation☆345Updated 3 months ago
- Examples for using ONNX Runtime for machine learning inferencing.☆1,601Updated this week