Alternatives and similar repositories for neural-compressor

Users that are interested in neural-compressor are comparing it to the libraries listed below

• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆61Updated 3 months ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆153Updated this week
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆41Updated last week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆271Updated 6 months ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆158Updated last year
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆76Updated 3 weeks ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆148Updated 3 weeks ago
• PINTO0309 / spo4onnx
  Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…
  ☆19Updated last year
• PINTO0309 / tflite2json2tflite
  Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.
  ☆27Updated 2 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 7 months ago
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆356Updated this week
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆31Updated 3 weeks ago
• PINTO0309 / scs4onnx
  A very simple tool that compresses the overall size of the ONNX model by aggregating duplicate constant values as much as possible.
  ☆52Updated 2 years ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆92Updated 7 months ago
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆17Updated last year
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆117Updated this week
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆39Updated 2 years ago
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆32Updated 2 months ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆179Updated 5 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆44Updated this week
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆149Updated last week
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated 8 months ago
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆172Updated 2 months ago
• justinchuby / model-explorer-onnx
  Visualize ONNX models with model-explorer
  ☆35Updated 2 weeks ago
• casper-hansen / AutoAWQ_kernels
  ☆74Updated 6 months ago
• pytorch / ort
  Accelerate PyTorch models with ONNX Runtime
  ☆363Updated 3 months ago
• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆51Updated last week
• HandH1998 / QQQ
  QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.
  ☆124Updated 2 months ago
• PINTO0309 / whisper-onnx-cpu
  ONNX implementation of Whisper. PyTorch free.
  ☆97Updated 6 months ago