NSTiwari / Llama3-on-Mobile
This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on-device inference.
☆70Updated 11 months ago
Alternatives and similar repositories for Llama3-on-Mobile
Users that are interested in Llama3-on-Mobile are comparing it to the libraries listed below
Sorting:
- A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android☆114Updated 3 weeks ago
- Embeddings from sentence-transformers in Android! Supports all-MiniLM-L6-V2, bge-small-en, snowflake-arctic, model2vec models and more☆45Updated 3 weeks ago
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆26Updated 10 months ago
- An Android App recreating the Simon Says game. Uses MediaPipe to run an LLM on device☆23Updated last month
- (OpenAI Fork) A collection of Compose libraries for advanced text formatting and alternative display types.☆54Updated this week
- Android wrapper for Inference Llama 2 in one file of pure C☆18Updated last year
- 📌This repo contains the kotlin implementation of TensorflowLite Example Android Apps🚀☆53Updated 3 years ago
- This repository is an implementation of inferring the PaliGemma Vision Language Model on Android using Hugging Face-Gradio Client API for…☆19Updated 7 months ago
- This project is an implementation of fine-tuning the Gemma 2b-it model on a custom dataset and deploy the model on Android.☆56Updated 10 months ago
- Showcase of diffusion models☆15Updated 2 years ago
- A light weight OpenAI's API client for Android☆20Updated 4 months ago
- IRIS is an android app for interfacing with GGUF / llama.cpp models locally.☆203Updated 3 months ago
- a sample project using Gemini, the Google's latest family of large language models.☆86Updated last year
- ChatGPT in Jetpack Compose using OpenAI API☆31Updated 2 years ago
- Inference Llama 2 in one file of pure C☆42Updated last year
- Android app for the Hole in your Palm project, making LLMs accessible on-device!☆17Updated last year
- Kotlin SDK for Llama Stack☆56Updated last month
- Some examples with MediaPipe☆14Updated last year
- An Android app running inference on Meta's Segment-Anything (SAM) and SAM v2☆37Updated 3 months ago
- Port of Andrej Karpathy's llama2.c to Kotlin.☆23Updated last year
- ☆104Updated 4 months ago
- LangChain for android/Java/JVM/Kotlin Multiplatform, using OpenAI chatGPT compatible APIs☆29Updated last year
- Unofficial Kotlin multiplatform variant of the Anthropic SDK☆39Updated this week
- Examples of Tensorflow Lite on Android☆79Updated 2 years ago
- ☆160Updated this week
- llama.cpp tutorial on Android phone☆101Updated last week
- ChatGPT-Multiplatform Mobile App☆31Updated 2 years ago
- ChatBot Builder is a kotlin compose multiplatform library that you can seamlessly customize the Chat UI to match the look and feel of you…☆56Updated last year
- ☆15Updated 2 years ago
- A proof of concept of Multiplatform Compose for Android and iOS using Google Gemini API☆21Updated last year