☆195Nov 14, 2026Updated this week
Alternatives and similar repositories for Awesome-On-Device-AI-Systems
Users that are interested in Awesome-On-Device-AI-Systems are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆98Dec 16, 2025Updated 11 months ago
- Fast Multimodal LLM on Mobile Devices☆1,641Sep 30, 2026Updated last month
- A curated list of awesome projects and papers for AI on Mobile/IoT/Edge devices. Everything is continuously updating. Welcome contributio…☆59Nov 5, 2026Updated 2 weeks ago
- Let's use Qualcomm NPU in Android☆21Feb 18, 2025Updated last year
- Self-implemented NN operators for Qualcomm's Hexagon NPU☆78Sep 30, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Multi-DNN Inference Engine for Heterogeneous Mobile Processors☆40Jul 24, 2024Updated 2 years ago
- Multi-branch model for concurrent execution☆18Jun 27, 2023Updated 3 years ago
- hexagon tutorial☆70Mar 29, 2026Updated 7 months ago
- Shared Memory-contention-aware Concurrent DNN Execution for Diversely Heterogeneous System-on-Chips☆11Jan 4, 2024Updated 2 years ago
- zTT: Learning-based DVFS with Zero Thermal Throttling for Mobile Devices [MobiSys'21] - Artifact Evaluation☆31May 10, 2021Updated 5 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆101Nov 3, 2026Updated 2 weeks ago
- [ASPLOS'25] Towards End-to-End Optimization of LLM-based Applications with Ayo☆80Mar 11, 2026Updated 8 months ago
- some hexagon intrinsic examples based on Qualcomm Hexagon☆18Mar 7, 2025Updated last year
- High-speed and easy-use LLM serving framework for local deployment☆169Aug 7, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Hexagon-MLIR is a compiler toolchain for compiling and executing AI kernels and models on Qualcomm Hexagon Neural Processing Units (NPUs)…☆286Updated this week
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆21Jul 19, 2024Updated 2 years ago
- Official codebase for the MLSys 2026 paper "IntAttention: A Fully Integer Attention Pipeline for Efficient Edge Inference". It enables hi…☆26May 29, 2026Updated 5 months ago
- MLPerf Mobile benchmarks☆16Nov 10, 2026Updated last week
- Accepted by NAACL 2025 main conference.☆11Jan 24, 2025Updated last year
- build alternative llama.cpp backend for Qualcomm Hexagon NPU (Android / WoS(Windows on Snapdragon) / Linux on Snapdragon), https://github…☆66Updated this week
- MobiSys#114☆23Aug 17, 2023Updated 3 years ago
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆22Oct 8, 2026Updated last month
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆69Sep 22, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- GPUReplay, ASPLOS 2022☆42Feb 21, 2022Updated 4 years ago
- ☆14Jun 19, 2025Updated last year
- TAOISM: A TEE-based Confidential Heterogeneous Deployment Framework for DNN Models☆52Apr 11, 2024Updated 2 years ago
- ☆19Feb 28, 2022Updated 4 years ago
- ☆102Jan 17, 2024Updated 2 years ago
- [ATC'25] Katz is a high-performance serving system designed specifically for diffusion model workflows with multiple adapters.☆25May 26, 2025Updated last year
- Ollama 기반의 int4 gguf 형식 sLLM을 multi-turn 형태로 대화할 수 있는 통합 모듈☆14Jul 25, 2024Updated 2 years ago
- ☆32Feb 3, 2026Updated 9 months ago
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆5,565Oct 20, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- MAGIS: Memory Optimization via Coordinated Graph Transformation and Scheduling for DNN (ASPLOS'24)☆58May 29, 2024Updated 2 years ago
- This is a repository accompanying the survey Edge AI Meets LLM (coming soon), containing a comprehensive list of papers, codebases, toolc…☆19Nov 5, 2026Updated 2 weeks ago
- ☆78May 28, 2023Updated 3 years ago
- YOLOv5在高通AI Engine Direct环境下进行QNN量化,CPU推理的项目☆17Sep 10, 2024Updated 2 years ago
- Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) an…☆1,265Updated this week
- A python library for converting Pytorch modules into a circle model that is a lightweight and efficient representation in ONE designed fo…☆17Nov 12, 2026Updated last week
- workflow of nndeploy☆14Nov 5, 2025Updated last year
Are these results useful?