Picovoice / picollmLinks
On-device LLM Inference Powered by X-Bit Quantization
☆273Updated last week
Alternatives and similar repositories for picollm
Users that are interested in picollm are comparing it to the libraries listed below
Sorting:
- On-device streaming text-to-speech engine powered by deep learning☆122Updated last week
- Recipes for on-device voice AI and local LLM☆98Updated last week
- VSCode AI coding assistant powered by self-hosted llama.cpp endpoint.☆183Updated 9 months ago
- Run LLMs in the Browser with MLC / WebLLM ✨☆148Updated last year
- 1.58 Bit LLM on Apple Silicon using MLX☆225Updated last year
- Setup and run a local LLM and Chatbot using consumer grade hardware.☆298Updated this week
- ☆491Updated this week
- A platform to self-host AI on easy mode☆177Updated last week
- Phi-3.5 for Mac: Locally-run Vision and Language Models for Apple Silicon☆275Updated 2 weeks ago
- Open source LLM UI, compatible with all local LLM providers.☆176Updated last year
- Locally running LLM with internet access☆97Updated 4 months ago
- Something similar to Apple Intelligence?☆61Updated last year
- ☆207Updated last year
- A simple experiment on letting two local LLM have a conversation about anything!☆112Updated last year
- Official implementation of "WhisperNER: Unified Open Named Entity and Speech Recognition"☆199Updated 9 months ago
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆124Updated 2 years ago
- In-browser LLM website generator☆50Updated 10 months ago
- ☆134Updated 7 months ago
- Pybind11 bindings for Whisper.cpp☆62Updated 3 weeks ago
- Joint speech-language model - respond directly to audio!☆372Updated last year
- FastMLX is a high performance production ready API to host MLX models.☆332Updated 8 months ago
- Running a LLM on the ESP32☆82Updated last year
- Code for Papeg.ai☆227Updated 10 months ago
- WebAssembly (Wasm) Build and Bindings for llama.cpp☆285Updated last year
- plug whisper audio transcription to a local ollama server and ouput tts audio responses☆360Updated last month
- Fast Streaming TTS with Orpheus + WebRTC (with FastRTC)☆344Updated 7 months ago
- Distributed Inference for mlx LLm☆99Updated last year
- A fast batching API to serve LLM models☆189Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆266Updated 8 months ago
- Awesome Mobile LLMs☆272Updated last week