Alternatives and similar repositories for onnx-safetensors:

Users that are interested in onnx-safetensors are comparing it to the libraries listed below

• onnx / neural-compressor
  Model compression for ONNX
  ☆91Updated 5 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆100Updated last week
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆341Updated this week
• onnx / turnkeyml
  Local LLM Server with NPU Acceleration
  ☆156Updated last week
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆32Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆75Updated 5 months ago
• abetlen / ggml-python
  Python bindings for ggml
  ☆140Updated 7 months ago
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆140Updated last week
• ROCm / pyrsmi
  python package of rocm-smi-lib
  ☆20Updated 7 months ago
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆266Updated 4 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆41Updated 8 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 6 months ago
• justinchuby / model-explorer-onnx
  Visualize ONNX models with model-explorer
  ☆31Updated last month
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆30Updated 2 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆68Updated 3 weeks ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆291Updated this week
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆168Updated 3 weeks ago
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆40Updated last month
• run-ai / runai-model-streamer
  ☆196Updated 3 weeks ago
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆140Updated this week
• sekstini / gpupoor
  ☆14Updated 4 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆115Updated this week
• ROCm / TransformerEngine
  ☆29Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆118Updated this week
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆375Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆185Updated this week
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆26Updated last week
• mag- / gpu_benchmark
  Gpu benchmark
  ☆59Updated 2 months ago
• huggingface / optimum-benchmark
  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…
  ☆295Updated 2 months ago
• coreweave / tensorizer
  Module, Model, and Tensor Serialization/Deserialization
  ☆223Updated 2 months ago