nota-github / MLC-VLM-template
Mobile (i.e., Android, iOS) foundation model (i.e., LLM, VLM) deployed with MLC
☆16Updated 3 months ago
Alternatives and similar repositories for MLC-VLM-template
Users that are interested in MLC-VLM-template are comparing it to the libraries listed below
Sorting:
- An Android app running inference on Meta's Segment-Anything (SAM) and SAM v2☆37Updated 3 months ago
- A proxy that hosts multiple single-model runners such as LLama.cpp and vLLM☆12Updated last month
- This repository is an implementation of inferring the PaliGemma Vision Language Model on Android using Hugging Face-Gradio Client API for…☆19Updated 7 months ago
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆17Updated last year
- ☆54Updated last year
- [EMNLP Findings 2024] MobileQuant: Mobile-friendly Quantization for On-device Language Models☆56Updated 7 months ago
- AI Assistant running within your browser.☆65Updated 5 months ago
- 👁️ Multimodal LLM vision multitool☆26Updated 7 months ago
- The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.☆11Updated last year
- Local first human friendly agents toolkit for the browser and Nodejs☆39Updated last week
- ☆21Updated last year
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆27Updated last week
- Mycomind Daemon: A mycelium-inspired, advanced Mixture-of-Memory-RAG-Agents (MoMRA) cognitive assistant that combines multiple AI models …☆32Updated 10 months ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆26Updated 3 months ago
- An integration of Segment Anything Model, Molmo, and, Whisper to segment objects using voice and natural language.☆25Updated 2 months ago
- Rivet plugin for integration with Ollama, the tool for running LLMs locally easily☆37Updated last year
- the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly☆31Updated 6 months ago
- Exploring retrieval systems for language models☆14Updated last month
- AI Search engine☆12Updated 2 months ago
- Open collaboration infrastructure that enables communication, coordination, trust and payments for The Internet of Agents.☆57Updated this week
- 5X faster 60% less memory QLoRA finetuning☆21Updated 11 months ago
- Passively collect images for computer vision datasets on the edge.☆33Updated last year
- 🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo☆7Updated last month
- Apex: An advanced autonomous coding agent for VS Code featuring total autonomy modes, recursive chain-of-thought reasoning, council-of-cr…☆24Updated this week
- AI Services API: serves langchain, huggingface, & other emergent python AI libraries as a service. This project mainly serves LibreChat, …☆28Updated last year
- LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT☆27Updated last year
- Running Microsoft's BitNet via Electron, React & Astro☆38Updated 3 weeks ago
- An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)☆15Updated last year
- https://narrateit.streamlit.app/☆36Updated 4 months ago
- Llama.cui is a small llama.cpp-based chat application for Node.js☆18Updated 2 months ago