NSTiwari / Gemma-on-Android
This project is an implementation of fine-tuning the Gemma 2b-it model on a custom dataset and deploy the model on Android.
☆42Updated 2 months ago
Related projects: ⓘ
- This repository is an implementation of quantizing and converting the Llama3-8B-Instruct model weights and deploying it on Android for on…☆45Updated 3 months ago
- A custom RAG pipeline for multi-document QA from PDF/DOCX documents, in Android☆38Updated last week
- This repository is an implementation of inferring the PaliGemma Vision Language Model on Android using Hugging Face-Gradio Client API for…☆12Updated 2 weeks ago
- Open source and AI-powered web search engine: local, private, dockerized and supported by a fluffy llama🦙☆49Updated last month
- A mobile Implementation of llama.cpp☆281Updated 7 months ago
- ☆166Updated last month
- LangChain for android/Java/JVM/Kotlin Multiplatform, using OpenAI chatGPT compatible APIs☆25Updated 11 months ago
- maid_llm is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)☆42Updated 3 weeks ago
- Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…☆77Updated 3 months ago
- Instantly calculate the maximum size of quantized language models that can fit in your available RAM, helping you optimize your models fo…☆50Updated 2 months ago
- Awesome LLM application repo☆56Updated 3 weeks ago
- From scratch implementation of a vision language model in pure PyTorch☆149Updated 4 months ago
- ☆62Updated 2 months ago
- Embeddings from sentence-transformers in Android! Uses all-MiniLM-L6-V2 model currently☆16Updated 3 weeks ago
- a collection of resources around LLMs, aggregated for the workshop "Mastering LLMs: End-to-End Fine-Tuning and Deployment" by Dan Becker …☆97Updated 3 months ago
- Inference Llama 2 in one file of pure C☆38Updated last year
- ONNX runtime for Flutter.☆200Updated 3 weeks ago
- ☆40Updated 6 months ago
- Build a Streamlit Chatbot using Langchain, ColBERT, Ragatouille, and ChromaDB☆115Updated 7 months ago
- Local LLM App☆114Updated this week
- ☆99Updated 2 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆84Updated 2 months ago
- Android app for running transformers locally using LLama.cpp & Whisper.cpp☆16Updated 2 months ago
- GRDN.AI app for garden optimization☆68Updated 7 months ago
- A memory framework for Large Language Models and Agents.☆157Updated last month
- ☆86Updated 3 weeks ago
- ☆74Updated 4 months ago
- MobiLlama : Small Language Model tailored for edge devices☆585Updated 6 months ago
- AI for all: Build the large graph of the language models☆220Updated 3 months ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆117Updated 3 weeks ago