MiniCPM on Android platform.
☆640Mar 19, 2025Updated last year
Alternatives and similar repositories for mlc
Users that are interested in mlc are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MiniCPM4 & MiniCPM4.1: Ultra-Efficient LLMs on End Devices, achieving 3+ generation speedup on reasoning tasks☆8,919Updated this week
- A Pocket-Sized MLLM for Ultra-Efficient Image and Video Understanding on Your Phone☆25,116Updated this week
- Port of Facebook's LLaMA model in C/C++☆114May 14, 2026Updated last week
- Universal LLM Deployment Engine with ML Compilation☆22,687May 11, 2026Updated last week
- ☆14May 21, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 参考自mlc-llm，个人尝试在android手机上部署大模型并运行☆90Aug 5, 2024Updated last year
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆95Apr 8, 2024Updated 2 years ago
- 使用Android手机的CPU推理stable diffusion☆158Dec 2, 2023Updated 2 years ago
- Get up and running with Llama 3, Mistral, Gemma, and other large language models.☆34Updated this week
- Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) an…☆1,045Updated this week
- 本项目是一个通过文字生成图片的项目，基于开源模型Stable Diffusion V1.5生成可以在手机的CPU和NPU上运行的模型，包括其配套的模型 运行框架。☆239Mar 29, 2024Updated 2 years ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆15Jan 22, 2025Updated last year
- ☆10Jul 18, 2024Updated last year
- Mobile-Agent: The Powerful GUI Agent Family☆8,687May 14, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,925May 26, 2025Updated 11 months ago
- MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.☆15,169May 12, 2026Updated last week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆91Updated this week
- Stable Diffusion AI client app for Android☆1,194Feb 15, 2026Updated 3 months ago
- Fast Multimodal LLM on Mobile Devices☆1,515Apr 30, 2026Updated 3 weeks ago
- The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.☆6,647Aug 7, 2024Updated last year
- Strong and Open Vision Language Assistant for Mobile Devices☆1,353Apr 15, 2024Updated 2 years ago
- Open source real-time translation app for Android that runs locally☆9,966May 14, 2026Updated last week
- Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral a…☆2,496Apr 7, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆309Sep 11, 2024Updated last year
- A mobile Implementation of llama.cpp☆328Feb 1, 2024Updated 2 years ago
- AppAgent: Multimodal Agents as Smartphone Users, an LLM-based multimodal agent framework designed to operate smartphone apps.☆6,744Mar 19, 2025Updated last year
- llm deploy project based mnn. This project has merged into MNN.☆1,616Jan 20, 2025Updated last year
- Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime…☆12,253May 15, 2026Updated last week
- [ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices☆668May 10, 2025Updated last year
- the original reference implementation of a specified llama.cpp backend for Qualcomm Hexagon NPU on Android phone, https://github.com/ggml…☆42Jul 14, 2025Updated 10 months ago
- GPT4V-level open-source multi-modal model based on Llama3-8B☆2,440Mar 3, 2025Updated last year
- GLM-4 series: Open Multilingual Multimodal Chat LMs | 开源多语言多模态对话模型☆7,073Jul 4, 2025Updated 10 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-p…☆9,304Updated this week
- ✨✨[NeurIPS 2025] VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction☆2,512Mar 28, 2025Updated last year
- a state-of-the-art-level open visual language model | 多模态预训练模型☆6,743May 29, 2024Updated last year
- A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity…☆16,101Mar 17, 2026Updated 2 months ago
- [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型☆10,038Sep 22, 2025Updated 8 months ago
- Pure C++ implementation of several models for real-time chatting on your computer (CPU & GPU)☆882Updated this week
- A generative speech model for daily dialogue.☆39,277Apr 10, 2026Updated last month