quic / ai-hub-models
The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
☆678Updated last week
Alternatives and similar repositories for ai-hub-models:
Users that are interested in ai-hub-models are comparing it to the libraries listed below
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆188Updated 3 weeks ago
- Supporting PyTorch models with the Google AI Edge TFLite runtime.☆566Updated this week
- ☆134Updated 2 months ago
- LiteRT is the new name for TensorFlow Lite (TFLite). While the name is new, it's still the same trusted, high-performance runtime for on-…☆375Updated this week
- Generative AI extensions for onnxruntime☆703Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆462Updated this week
- ☆321Updated last year
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆269Updated this week
- nvidia-modelopt is a unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculat…☆900Updated last week
- Examples for using ONNX Runtime for machine learning inferencing.☆1,374Updated 3 weeks ago
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,005Updated this week
- On-device AI across mobile, embedded and edge for PyTorch☆2,807Updated this week
- Self-Created Tools to convert ONNX files (NCHW) to TensorFlow/TFLite/Keras format (NHWC). The purpose of this tool is to solve the massiv…☆789Updated 3 weeks ago
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,293Updated this week
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆270Updated last year
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆380Updated this week
- ONNX Optimizer☆700Updated last week
- A parser, editor and profiler tool for ONNX models.☆430Updated 3 months ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆620Updated last week
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆2,011Updated this week
- Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …☆60Updated 6 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,482Updated 2 months ago
- PyTorch Neural Network eXchange☆581Updated last week
- A pytorch quantization backend for optimum☆928Updated 2 weeks ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,387Updated last week
- An innovative library for efficient LLM inference via low-bit quantization☆350Updated 8 months ago
- A simple tutorial of SNPE.☆171Updated 2 years ago
- Demonstration of combine YOLO and depth estimation on Android device.☆45Updated last month
- Advanced Quantization Algorithm for LLMs/VLMs.☆449Updated last week
- Low-bit LLM inference on CPU with lookup table☆765Updated 2 weeks ago