Awesome Mobile LLMs
☆418Oct 27, 2026Updated 3 weeks ago
Alternatives and similar repositories for awesome-mobile-llm
Users that are interested in awesome-mobile-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast Multimodal LLM on Mobile Devices☆1,643Sep 30, 2026Updated last month
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆21Jul 19, 2024Updated 2 years ago
- The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]☆20Aug 4, 2022Updated 4 years ago
- High-speed and easy-use LLM serving framework for local deployment☆169Aug 7, 2025Updated last year
- TinyChatEngine: On-Device LLM Inference Library☆974Jul 4, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Demonstration of running a native LLM on Android device.☆269Aug 14, 2026Updated 3 months ago
- ☆195Updated this week
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,472Apr 30, 2026Updated 6 months ago
- Code for "All for One: LLMs Solve Mental Math at the Last Token With Information Transferred From Other Tokens"☆11Sep 11, 2025Updated last year
- On-device AI across mobile, embedded and edge for PyTorch☆5,181Updated this week
- Low-bit LLM inference on CPU/NPU with lookup table☆1,007Jun 5, 2025Updated last year
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆486Updated this week
- ☆42Mar 29, 2025Updated last year
- lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)☆124Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆101Nov 3, 2026Updated 2 weeks ago
- ☆34Oct 26, 2026Updated 3 weeks ago
- ☆102Jan 17, 2024Updated 2 years ago
- Running any GGUF SLMs/LLMs locally, on-device in Android☆915Updated this week
- Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agents☆33Dec 6, 2024Updated last year
- ☆29Oct 25, 2023Updated 3 years ago
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆19May 3, 2024Updated 2 years ago
- A curated list for Efficient Large Language Models☆2,052Jun 17, 2025Updated last year
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Mar 13, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [TMLR 2024] Efficient Large Language Models: A Survey☆1,261Oct 30, 2026Updated 2 weeks ago
- Universal LLM Deployment Engine with ML Compilation☆23,401Updated this week
- A minimal, un-opinionated agent library for Swift providing conversation and tool calling☆17May 20, 2026Updated 5 months ago
- Shared Memory-contention-aware Concurrent DNN Execution for Diversely Heterogeneous System-on-Chips☆11Jan 4, 2024Updated 2 years ago
- Every agent turn becomes a traceable commit carrying the full interaction trace, model, and token cost, plus a live dashboard and a coach…☆25Nov 9, 2026Updated last week
- ☆37May 28, 2024Updated 2 years ago
- Beginner-friendly serverless LLM deployment with Replicate & fly.io☆13Sep 3, 2023Updated 3 years ago
- Awesome LLM compression research papers and tools.☆1,898Updated this week
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- FastRPC is Qualcomm's userspace library that facilitates efficient remote procedure calls between the CPU and DSP for high-performance co…☆125Nov 13, 2026Updated last week
- This is a repository for the course "From Beginner to LLM Developer" by Towards AI.☆13Jan 2, 2025Updated last year
- A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android☆203Jan 3, 2026Updated 10 months ago
- List Flower resources☆12Feb 4, 2022Updated 4 years ago
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆5,565Oct 20, 2026Updated last month
- Super simple self mutating AI coding agent. 1 file, 1 tool, stdlib only.☆23Sep 11, 2026Updated 2 months ago
- ☆11May 25, 2026Updated 5 months ago
Are these results useful?