quic / ai-hub-modelsLinks
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
☆792Updated this week
Alternatives and similar repositories for ai-hub-models
Users that are interested in ai-hub-models are comparing it to the libraries listed below
Sorting:
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆284Updated 2 weeks ago
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆777Updated this week
- LiteRT continues the legacy of TensorFlow Lite as the trusted, high-performance runtime for on-device AI. Now with LiteRT Next, we're exp…☆801Updated this week
- Generative AI extensions for onnxruntime☆825Updated this week
- ☆156Updated 2 months ago
- Examples for using ONNX Runtime for machine learning inferencing.☆1,474Updated last week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆334Updated this week
- On-device AI across mobile, embedded and edge for PyTorch☆3,221Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,045Updated this week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆69Updated this week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆411Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆489Updated this week
- TinyChatEngine: On-Device LLM Inference Library☆894Updated last year
- A Toolkit to Help Optimize Onnx Model☆214Updated last week
- ☆334Updated last year
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆851Updated last month
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,344Updated last week
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆294Updated last year
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,492Updated this week
- Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.☆2,106Updated this week
- ☆972Updated 2 months ago
- Efficient Inference of Transformer models☆459Updated last year
- llm-export can export llm model to onnx.☆308Updated 2 weeks ago
- Low-bit LLM inference on CPU/NPU with lookup table☆852Updated 3 months ago
- Conversion of PyTorch Models into TFLite☆391Updated 2 years ago
- A pytorch quantization backend for optimum☆987Updated 3 weeks ago
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆79Updated last week
- ONNX Optimizer☆753Updated last month
- Common utilities for ONNX converters☆279Updated last week
- This repository contains tutorials and examples for Triton Inference Server☆768Updated last week