Awesome Mobile LLMs
☆413Oct 27, 2026Updated this week
Alternatives and similar repositories for awesome-mobile-llm
Users that are interested in awesome-mobile-llm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fast Multimodal LLM on Mobile Devices☆1,631Sep 30, 2026Updated last month
- codebase for "MELTing Point: Mobile Evaluation of Language Transformers"☆21Jul 19, 2024Updated 2 years ago
- The open-source project for "Mandheling: Mixed-Precision On-Device DNN Training with DSP Offloading"[MobiCom'2022]☆20Aug 4, 2022Updated 4 years ago
- TinyChatEngine: On-Device LLM Inference Library☆970Jul 4, 2024Updated 2 years ago
- Demonstration of running a native LLM on Android device.☆265Aug 14, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆192Sep 14, 2026Updated last month
- High-speed and easy-use LLM serving framework for local deployment☆167Aug 7, 2025Updated last year
- Strong and Open Vision Language Assistant for Mobile Devices☆1,371Apr 15, 2024Updated 2 years ago
- Code for "All for One: LLMs Solve Mental Math at the Last Token With Information Transferred From Other Tokens"☆11Sep 11, 2025Updated last year
- MobileLLM Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. In ICML 2024.☆1,471Apr 30, 2026Updated 6 months ago
- lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)☆122Updated this week
- Low-bit LLM inference on CPU/NPU with lookup table☆1,000Jun 5, 2025Updated last year
- On-device AI across mobile, embedded and edge for PyTorch☆5,142Updated this week
- A curated list for Efficient Large Language Models☆2,047Jun 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Example apps and demos using PyTorch's ExecuTorch framework☆87Updated this week
- ☆42Mar 29, 2025Updated last year
- ☆101Jan 17, 2024Updated 2 years ago
- Running any GGUF SLMs/LLMs locally, on-device in Android☆899Updated this week
- Simple LLM package for ios devices.☆36May 28, 2026Updated 5 months ago
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆19May 3, 2024Updated 2 years ago
- PyTorch compilation tutorial covering TorchScript, torch.fx, and Slapo☆17Mar 13, 2023Updated 3 years ago
- The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) a…☆473Updated this week
- A minimal, un-opinionated agent library for Swift providing conversation and tool calling☆17May 20, 2026Updated 5 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Universal LLM Deployment Engine with ML Compilation☆23,284Updated this week
- State-of-the-Art Deep Learning Models in TensorFlow Modern Machine Learning in the Google Colab Ecosystem☆10Jan 24, 2023Updated 3 years ago
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆99Jul 27, 2026Updated 3 months ago
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆5,542Oct 20, 2026Updated last week
- ☆13Sep 18, 2025Updated last year
- Awesome LLM compression research papers and tools.☆1,890Updated this week
- A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android☆200Jan 3, 2026Updated 9 months ago
- Code Repository for Blog - How to Productionize Large Language Models (LLMs)☆12Mar 27, 2024Updated 2 years ago
- This is a repository for the course "From Beginner to LLM Developer" by Towards AI.☆13Jan 2, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Agent Watch is an AgentOps monitoring library designed for Crew AI applications.☆23Dec 2, 2024Updated last year
- This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai☆201Updated this week
- llama and other large language models on iOS and MacOS offline using GGML library.☆2,080Jan 30, 2026Updated 9 months ago
- ☆11May 25, 2026Updated 5 months ago
- paper and its code for AI System☆381May 14, 2026Updated 5 months ago
- ☆19Nov 19, 2025Updated 11 months ago
- LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watch…☆882Jul 19, 2026Updated 3 months ago