Alternatives and similar repositories for neural-compressor:

Users that are interested in neural-compressor are comparing it to the libraries listed below

• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆136Updated this week
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆68Updated 2 weeks ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆106Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆257Updated last month
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆313Updated this week
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆15Updated 8 months ago
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆37Updated 2 years ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆31Updated 4 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆257Updated 3 months ago
• PINTO0309 / spo4onnx
  Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…
  ☆19Updated 8 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆66Updated this week
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆155Updated this week
• microsoft / DeepSpeed-Kernels
  ☆58Updated 8 months ago
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆153Updated 8 months ago
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆96Updated 3 months ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 3 months ago
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆141Updated last week
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆57Updated this week
• triton-inference-server / developer_tools
  ☆18Updated last week
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆45Updated last year
• octoml / octoml-profile
  Home for OctoML PyTorch Profiler
  ☆107Updated last year
• masahi / torchscript-to-tvm
  ☆69Updated last year
• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆48Updated last week
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆90Updated 3 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• Adlik / smoothquantplus
  [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
  ☆20Updated 10 months ago
• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆188Updated 7 months ago
• PINTO0309 / onnx2json
  Exports the ONNX file to a JSON file and JSON dict.
  ☆33Updated 2 years ago
• fumihwh / onnx-pytorch
  A code generator from ONNX to PyTorch code
  ☆135Updated 2 years ago