Alternatives and similar repositories for ai-edge-quantizer

Users that are interested in ai-edge-quantizer are comparing it to the libraries listed below

• onnx / neural-compressor
  Model compression for ONNX
  ☆99Updated last year
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆304Updated last year
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆288Updated this week
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆85Updated this week
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆17Updated 2 months ago
• SonySemiconductorSolutions / mct-model-optimization
  Model Compression Toolkit (MCT) is an open source project for neural network model optimization under efficient, constrained hardware. Th…
  ☆428Updated last week
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆35Updated 3 weeks ago
• justinchuby / model-explorer-onnx
  Visualize ONNX models with model-explorer
  ☆66Updated 2 weeks ago
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆414Updated this week
• PINTO0309 / tflite2json2tflite
  Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.
  ☆28Updated 2 years ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆78Updated 2 months ago
• google-ai-edge / ai-edge-torch
  Supporting PyTorch models with the Google AI Edge TFLite runtime.
  ☆880Updated last week
• meta-pytorch / tokenizers
  C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
  ☆44Updated last week
• fastmachinelearning / qonnx
  QONNX: Arbitrary-Precision Quantized Neural Networks in ONNX
  ☆168Updated this week
• saic-fi / MobileQuant
  [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models
  ☆68Updated last year
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆54Updated last month
• NVIDIA-AI-IOT / whisper_trt
  A project that optimizes Whisper for low latency inference using NVIDIA TensorRT
  ☆94Updated last year
• huggingface / optimum-executorch
  🤗 Optimum ExecuTorch
  ☆93Updated last week
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆64Updated 7 months ago
• mlcommons / mobile_app_open
  Mobile App Open
  ☆66Updated this week
• PINTO0309 / whisper-onnx-cpu
  ONNX implementation of Whisper. PyTorch free.
  ☆102Updated last year
• google / jaxonnxruntime
  A user-friendly tool chain that enables the seamless execution of ONNX models using JAX as the backend.
  ☆125Updated last week
• PINTO0309 / whisper-onnx-tensorrt
  ONNX and TensorRT implementation of Whisper
  ☆66Updated 2 years ago
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆89Updated 3 weeks ago
• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆108Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆162Updated 2 months ago
• Libraries-Openly-Fused / FusedKernelLibrary
  Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.
  ☆37Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆289Updated last week
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆109Updated last week