quic / ai-hub-modelsLinks
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
☆777Updated last week
Alternatives and similar repositories for ai-hub-models
Users that are interested in ai-hub-models are comparing it to the libraries listed below
Sorting:
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆273Updated last week
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆763Updated this week
- LiteRT continues the legacy of TensorFlow Lite as the trusted, high-performance runtime for on-device AI. Now with LiteRT Next, we're exp…☆748Updated this week
- ☆154Updated 2 months ago
- On-device AI across mobile, embedded and edge for PyTorch☆3,179Updated last week
- Generative AI extensions for onnxruntime☆813Updated last week
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆331Updated this week
- Fast Multimodal LLM on Mobile Devices☆1,024Updated this week
- ☆333Updated last year
- Demonstration of running a native LLM on Android device.☆174Updated 2 weeks ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆486Updated last week
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆409Updated last week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆850Updated last month
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,200Updated this week
- LLM inference in C/C++☆45Updated last week
- A Toolkit to Help Optimize Onnx Model☆205Updated 2 weeks ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,075Updated this week
- Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …☆66Updated last month
- TinyChatEngine: On-Device LLM Inference Library☆889Updated last year
- Examples for using ONNX Runtime for machine learning inferencing.☆1,461Updated last week
- llm-export can export llm model to onnx.☆306Updated this week
- Conversion of PyTorch Models into TFLite☆390Updated 2 years ago
- A parser, editor and profiler tool for ONNX models.☆454Updated last month
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆293Updated last year
- Low-bit LLM inference on CPU/NPU with lookup table☆848Updated 3 months ago
- Efficient Inference of Transformer models☆451Updated last year
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆68Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,488Updated this week
- Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…☆611Updated this week
- A pytorch quantization backend for optimum☆985Updated last week