Picovoice / picollm
On-device LLM Inference Powered by X-Bit Quantization
☆212Updated this week
Alternatives and similar repositories for picollm:
Users that are interested in picollm are comparing it to the libraries listed below
- Recipes for on-device voice AI and local LLM☆76Updated 3 weeks ago
- Open source LLM UI, compatible with all local LLM providers.☆170Updated 5 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆530Updated this week
- automatically quant GGUF models☆154Updated this week
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆181Updated 3 weeks ago
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆117Updated last year
- Awesome Mobile LLMs☆139Updated last week
- ☆75Updated last month
- On-device streaming text-to-speech engine powered by deep learning☆70Updated this week
- Code for Papeg.ai☆220Updated last month
- Replace OpenAI with Llama.cpp Automagically.☆308Updated 8 months ago
- Local ML voice chat using high-end models.☆159Updated this week
- A simple speech-to-text and text-to-speech AI chatbot that can be run fully offline.☆44Updated last year
- Something similar to Apple Intelligence?☆59Updated 7 months ago
- A multimodal, function calling powered LLM webui.☆214Updated 4 months ago
- LIVA - Local Intelligent Voice Assistant☆61Updated 5 months ago
- ☆83Updated 3 weeks ago
- A mobile Implementation of llama.cpp☆303Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆184Updated 9 months ago
- Locally running LLM with internet access☆93Updated 4 months ago
- An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.☆68Updated 2 weeks ago
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆95Updated 2 months ago
- ☆91Updated last month
- A simple experiment on letting two local LLM have a conversation about anything!☆104Updated 7 months ago
- ☆124Updated 2 weeks ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆114Updated 8 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆85Updated 6 months ago
- FastMLX is a high performance production ready API to host MLX models.☆260Updated 2 months ago
- A fast batching API to serve LLM models☆180Updated 9 months ago