Alternatives and similar repositories for neural-compressor:

Users that are interested in neural-compressor are comparing it to the libraries listed below

• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆32Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆140Updated last week
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆124Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆259Updated 3 months ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆153Updated 10 months ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆89Updated 4 months ago
• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆50Updated this week
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆323Updated this week
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆38Updated 2 years ago
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆70Updated last week
• PINTO0309 / tflite2json2tflite
  Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.
  ☆27Updated 2 years ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆97Updated 4 months ago
• PINTO0309 / spo4onnx
  Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…
  ☆19Updated 10 months ago
• PINTO0309 / scs4onnx
  A very simple tool that compresses the overall size of the ONNX model by aggregating duplicate constant values as much as possible.
  ☆52Updated 2 years ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆91Updated this week
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆31Updated 2 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆179Updated 3 months ago
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆358Updated 3 weeks ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 5 months ago
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆262Updated 11 months ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆51Updated 2 weeks ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 5 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆263Updated this week
• levipereira / yolov9-qat
  Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.
  ☆102Updated 3 weeks ago
• Qualcomm-AI-research / FP8-quantization
  ☆141Updated 2 years ago
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated last week
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆27Updated this week
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆109Updated 3 weeks ago
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆290Updated 10 months ago