Picovoice / picollmLinks
On-device LLM Inference Powered by X-Bit Quantization
☆256Updated last month
Alternatives and similar repositories for picollm
Users that are interested in picollm are comparing it to the libraries listed below
Sorting:
- On-device streaming text-to-speech engine powered by deep learning☆98Updated this week
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 5 months ago
- Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)☆299Updated 3 months ago
- Recipes for on-device voice AI and local LLM☆89Updated last month
- ☆267Updated this week
- Lightweight Inference server for OpenVINO☆188Updated this week
- FastMLX is a high performance production ready API to host MLX models.☆313Updated 4 months ago
- 1.58 Bit LLM on Apple Silicon using MLX☆214Updated last year
- ☆131Updated 2 months ago
- SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.☆273Updated last month
- Locally running LLM with internet access☆96Updated 2 weeks ago
- plug whisper audio transcription to a local ollama server and ouput tts audio responses☆338Updated last year
- Running a LLM on the ESP32☆73Updated 9 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆116Updated last year
- Open source LLM UI, compatible with all local LLM providers.☆175Updated 9 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆257Updated 4 months ago
- ☆204Updated 2 months ago
- Local ML voice chat using high-end models.☆174Updated last week
- 🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis☆100Updated 7 months ago
- ☆145Updated this week
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆271Updated 11 months ago
- Setup and run a local LLM and Chatbot using consumer grade hardware.☆269Updated 3 weeks ago
- Self-host LLMs with vLLM and BentoML☆134Updated 2 weeks ago
- Something similar to Apple Intelligence?☆61Updated last year
- Open-source Perplexity app.☆129Updated this week
- Run LLMs in the Browser with MLC / WebLLM ✨☆134Updated 9 months ago
- API Server for Transformer Lab☆70Updated this week
- A simple experiment on letting two local LLM have a conversation about anything!☆110Updated last year
- Replace OpenAI with Llama.cpp Automagically.☆320Updated last year
- Code for Papeg.ai☆225Updated 6 months ago