NSTiwari / Llama3-on-MobileLinks
This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on-device inference.
☆70Updated last year
Alternatives and similar repositories for Llama3-on-Mobile
Users that are interested in Llama3-on-Mobile are comparing it to the libraries listed below
Sorting:
- A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android☆121Updated last week
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆26Updated last year
- This repository is an implementation of inferring the PaliGemma Vision Language Model on Android using Hugging Face-Gradio Client API for…☆19Updated 8 months ago
- Showcase of diffusion models☆15Updated 2 years ago
- An Android App recreating the Simon Says game. Uses MediaPipe to run an LLM on device☆23Updated last week
- Kotlin SDK for Llama Stack☆63Updated last month
- Inference Llama 2 in one file of pure C☆42Updated last year
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆17Updated last year
- Embeddings from sentence-transformers in Android! Supports all-MiniLM-L6-V2, bge-small-en, snowflake-arctic, model2vec models and more☆48Updated last week
- 📌This repo contains the kotlin implementation of TensorflowLite Example Android Apps🚀☆53Updated 3 years ago
- This project is an implementation of fine-tuning the Gemma 2b-it model on a custom dataset and deploy the model on Android.☆59Updated 11 months ago
- (OpenAI Fork) A collection of Compose libraries for advanced text formatting and alternative display types.☆61Updated 2 weeks ago
- Android wrapper for Inference Llama 2 in one file of pure C☆18Updated last year
- Examples of Tensorflow Lite on Android☆80Updated 2 years ago
- ChatGPT in Jetpack Compose using OpenAI API☆31Updated 2 years ago
- LangChain for android/Java/JVM/Kotlin Multiplatform, using OpenAI chatGPT compatible APIs☆29Updated last year
- Kotlin Multiplatform project for Android, iOS, and Desktop demonstrating local AI chat with DeepSeek R1 (LLaMA). Run on-device LLMs seaml…☆19Updated 4 months ago
- Power of GloVe word embeddings in Android☆16Updated last year
- Compose Multiplatform app generates images using Stability AI☆60Updated last year
- ChatGPT-Multiplatform Mobile App☆31Updated 2 years ago
- a sample project using Gemini, the Google's latest family of large language models.☆86Updated last year
- A light weight OpenAI's API client for Android☆22Updated 5 months ago
- Some examples with MediaPipe☆14Updated last year
- Extract a per-frame color from video and render to an image☆46Updated last week
- ChatBot Builder is a kotlin compose multiplatform library that you can seamlessly customize the Chat UI to match the look and feel of you…☆56Updated last year
- IRIS is an android app for interfacing with GGUF / llama.cpp models locally.☆216Updated 4 months ago
- llama.cpp tutorial on Android phone☆110Updated last month
- A Kotlin Multiplatform Project utilizing ggwave, a data-over-sound library.☆20Updated 7 months ago
- Combine Flutter with Kotlin Multiplatform (KMP)☆14Updated 2 months ago
- Discover the power of AI with our Kotlin Multiplatform app. Choose from the latest open-source text and image models to boost your creati…☆47Updated last week