Alternatives and similar repositories for neural-compressor

Users that are interested in neural-compressor are comparing it to the libraries listed below

• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆163Updated 3 months ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆87Updated this week
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆54Updated 2 months ago
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆35Updated 3 weeks ago
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆96Updated last week
• meta-pytorch / tokenizers
  C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
  ☆48Updated last week
• triple-mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆42Updated 3 years ago
• PINTO0309 / tflite2json2tflite
  Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.
  ☆28Updated 2 years ago
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆65Updated 9 months ago
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆294Updated last month
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆306Updated last year
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆173Updated this week
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆420Updated last week
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆85Updated last week
• justinchuby / model-explorer-onnx
  Visualize ONNX models with model-explorer
  ☆67Updated last month
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated last year
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆409Updated this week
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆95Updated last year
• vllm-project / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆244Updated this week
• PINTO0309 / simple-onnx-processing-tools
  A set of simple tools for splitting, merging, OP deletion, size compression, rewriting attributes and constants, OP generation, change op…
  ☆303Updated last year
• meta-pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆182Updated last month
• PINTO0309 / spo4onnx
  Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…
  ☆19Updated last year
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆98Updated last year
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆85Updated last week
• NVIDIA / nvImageCodec
  A nvImageCodec library of GPU- and CPU- accelerated codecs featuring a unified interface
  ☆139Updated last month
• PINTO0309 / scs4onnx
  A very simple tool that compresses the overall size of the ONNX model by aggregating duplicate constant values as much as possible.
  ☆52Updated 3 years ago
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆70Updated 2 years ago
• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• SonySemiconductorSolutions / mct-model-optimization
  Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…
  ☆432Updated this week
• onnx / ir-py
  Efficient in-memory representation for ONNX, in Python
  ☆42Updated this week