☆32Aug 3, 2026Updated last month
Alternatives and similar repositories for llama-cpp-qnn-builder
Users that are interested in llama-cpp-qnn-builder are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LLM inference in C/C++☆22Oct 22, 2025Updated 11 months ago
- LLM inference in C/C++☆54Sep 3, 2026Updated 2 weeks ago
- Alternative llama.cpp backend for Qualcomm Hexagon NPU (Android / WoS(Windows on Snapdragon) / Linux), https://github.com/kan-linux/ggml-…☆57Updated this week
- snpe tutorial☆10Dec 25, 2023Updated 2 years ago
- Inference of YOLOv7 model applied on Qualcomm SNPE for pedestrian detection with embedded system.☆14Sep 23, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A CUDA kernel for NHWC GroupNorm for PyTorch☆26Nov 15, 2024Updated last year
- Hopenet: deep head pose estimator on ncnn☆10Jun 18, 2020Updated 6 years ago
- Ultra fast head pose estimation on a bare Raspberry Pi 4 at 20 FPS☆10Dec 21, 2021Updated 4 years ago
- High-speed and easy-use LLM serving framework for local deployment☆166Aug 7, 2025Updated last year
- High-performance system monitor for Rockchip SoCs (RK3588, RK3399) with real-time CPU, GPU, NPU, RGA, memory, and process monitoring. W…☆32Nov 25, 2025Updated 9 months ago
- onnxruntime-qnn is the Qualcomm AI Runtime (QAIRT) execution provider for onnxruntime. It provides onnxruntime hardware acceleration and …☆51Updated this week
- Optimized pose detector inference for edge devices☆15Feb 23, 2023Updated 3 years ago
- FastRPC is Qualcomm's userspace library that facilitates efficient remote procedure calls between the CPU and DSP for high-performance co…☆114Updated this week
- QAI AppBuilder is designed to help developers easily execute models on WoS and Linux platforms. It encapsulates the Qualcomm® AI Runtime …☆243Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- hexagon tutorial☆66Mar 29, 2026Updated 5 months ago
- ☆13Oct 17, 2024Updated last year
- Shadowsocks/ShadowsocksR 账号在线监控☆12Nov 25, 2018Updated 7 years ago
- Self-implemented NN operators for Qualcomm's Hexagon NPU☆77Sep 30, 2025Updated 11 months ago
- A Android Library for YOLOv5/YOLOv7/YOLOv8 Detection and Pose Inference Based on NCNN☆60Aug 15, 2024Updated 2 years ago
- Vue.js wrapper over canvas manipulation library fabric.js — **Note: not quite ready for prime time**☆11Nov 27, 2016Updated 9 years ago
- 智能家教微信小程序☆11Sep 15, 2018Updated 8 years ago
- ☆17Apr 9, 2025Updated last year
- 使用repo管理github项目例子☆10Aug 29, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- 使用onnxruntime部署Gaze-LLE凝视目标估计，包含C++和Python两个版本的程序☆17Jan 21, 2025Updated last year
- Python utility to convert PyTorch model weights from '.bin' to '.safetensors' format.☆18Sep 19, 2025Updated last year
- ☆15Apr 28, 2023Updated 3 years ago
- 官方transformers源码解析。AI大模型时代，pytorch、transformer是新操作系统，其他都是运行在其上面的软件。☆16Sep 25, 2023Updated 2 years ago
- CUDA SGEMM optimization note☆16Oct 31, 2023Updated 2 years ago
- Bjontegaard metric calculation. Include BD-PSNR and BD-rate☆14Sep 4, 2024Updated 2 years ago
- An example app of DNNLibrary :)☆13Jul 26, 2019Updated 7 years ago
- ☆12May 19, 2025Updated last year
- Acclaim: Adaptive Memory Reclaim to Improve User Experience in Android Systems [ATC '20]☆16Aug 1, 2020Updated 6 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Build environment for Raspberry Pi Pico (RP2040) C/C++ SDK☆11Jan 25, 2021Updated 5 years ago
- 🎵 Control YouTube players with browser by Alfred☆12Sep 30, 2020Updated 5 years ago
- [ACL2025 Oral🔥]Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling☆30Nov 11, 2025Updated 10 months ago
- Code for paper "ElasticTrainer: Speeding Up On-Device Training with Runtime Elastic Tensor Selection" (MobiSys'23)☆14Nov 1, 2023Updated 2 years ago
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型运行框架。☆248Mar 29, 2024Updated 2 years ago
- ☆13Mar 18, 2024Updated 2 years ago
- Artifacts of VLDB'22 paper "COMET: A Novel Memory-Efficient Deep Learning TrainingFramework by Using Error-Bounded Lossy Compression"☆10Aug 2, 2022Updated 4 years ago