NSTiwari / Llama3-on-Mobile
This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on-device inference.
☆69Updated 8 months ago
Alternatives and similar repositories for Llama3-on-Mobile:
Users that are interested in Llama3-on-Mobile are comparing it to the libraries listed below
- A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android☆85Updated last week
- Android wrapper for Inference Llama 2 in one file of pure C☆18Updated last year
- Inference Llama 2 in one file of pure C☆42Updated last year
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆27Updated 8 months ago
- Embeddings from sentence-transformers in Android! Supports all-MiniLM-L6-V2, bge-small-en, snowflake-arctic models and more☆36Updated 3 months ago
- (OpenAI Fork) A collection of Compose libraries for advanced text formatting and alternative display types.☆45Updated 3 weeks ago
- ☆129Updated 2 weeks ago
- This repository is an implementation of inferring the PaliGemma Vision Language Model on Android using Hugging Face-Gradio Client API for…☆20Updated 4 months ago
- Examples of Tensorflow Lite on Android☆77Updated 2 years ago
- Running any GGUF SLMs/LLMs locally, on-device in Android☆188Updated this week
- Kotlin SDK for Llama Stack☆45Updated last week
- This project is an implementation of fine-tuning the Gemma 2b-it model on a custom dataset and deploy the model on Android.☆52Updated 7 months ago
- An Android App recreating the Simon Says game. Uses MediaPipe to run an LLM on device☆23Updated 8 months ago
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆13Updated 9 months ago
- 📌This repo contains the kotlin implementation of TensorflowLite Example Android Apps🚀☆51Updated 2 years ago
- ChatGPT in Jetpack Compose using OpenAI API☆31Updated last year
- Android code for extracting all frames from videos with high performance☆47Updated 2 years ago
- Some examples with MediaPipe☆14Updated 10 months ago
- ChatGPT-Multiplatform Mobile App☆30Updated last year
- Port of Andrej Karpathy's llama2.c to Kotlin.☆23Updated last year
- LangChain for android/Java/JVM/Kotlin Multiplatform, using OpenAI chatGPT compatible APIs☆27Updated last year
- Compose Multiplatform app generates images using Stability AI☆57Updated 10 months ago
- A Kotlin multi-platform wrapper around the PyTorch Lite libraries on Android and iOS.☆40Updated 6 months ago
- ChatBot Builder is a kotlin compose multiplatform library that you can seamlessly customize the Chat UI to match the look and feel of you…☆55Updated 11 months ago
- The TTS-Engine is a simple and efficient library that provides Text-to-Speech functionality for Android applications. The library uses st…☆21Updated 7 months ago
- A mobile Implementation of llama.cpp☆303Updated last year
- Image Tagger: AI-based Android App for Automated Image Annotation☆20Updated 3 years ago
- a sample project using Gemini, the Google's latest family of large language models.☆85Updated last year
- Compiler-driven MCP framework for Kotlin Multiplatform☆24Updated 3 weeks ago
- ☆72Updated last month