Picovoice / picollm
On-device LLM Inference Powered by X-Bit Quantization
☆159Updated this week
Related projects: ⓘ
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆97Updated last year
- Replace OpenAI with Llama.cpp Automagically.☆277Updated 3 months ago
- Pybind11 bindings for Whisper.cpp☆38Updated 2 weeks ago
- ☆181Updated 3 months ago
- Multi-node production AI stack. Run the best of open source AI easily on your own servers. Create your own AI by fine-tuning open source …☆319Updated this week
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆140Updated last month
- Recipes for on-device voice AI and local LLM☆63Updated this week
- WebAssembly binding for llama.cpp - Enabling in-browser LLM inference☆342Updated last week
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆467Updated last month
- AI Raspberry Pi cat detection and notification: get a text when your cat does something it's not supposed to do, and have AI narrate what…☆156Updated 4 months ago
- Open source LLM UI, compatible with all local LLM providers.☆163Updated last week
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆459Updated this week
- Locally running LLM with internet access☆91Updated 2 weeks ago
- Local ML voice chat using high-end models.☆138Updated last week
- On-device streaming text-to-speech engine powered by deep learning☆43Updated last week
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆219Updated 8 months ago
- FastMLX is a high performance production ready API to host MLX models.☆163Updated last week
- ☆194Updated this week
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆226Updated 2 weeks ago
- Action library for AI Agent☆187Updated this week
- Joint speech-language model - respond directly to audio!☆312Updated 2 months ago
- Chat with your current directory's files using a local or API LLM.☆169Updated 3 weeks ago
- A python application that routes incoming prompts to an LLM by category, and can support a single incoming connection from a front end to…☆133Updated this week
- Gradio based tool to run opensource LLM models directly from Huggingface☆84Updated 2 months ago
- Mistral7B playing DOOM☆117Updated 2 months ago
- multi1: create o1-like reasoning chains with multiple AI providers (and locally)☆64Updated this week
- A mobile Implementation of llama.cpp☆281Updated 7 months ago
- Start a server from the MLX library.☆157Updated last month
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆430Updated this week
- Something similar to Apple Intelligence?☆54Updated 2 months ago