On-device LLM Inference Powered by X-Bit Quantization
☆317Aug 11, 2026Updated last week
Alternatives and similar repositories for picollm
Users that are interested in picollm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- On-device streaming text-to-speech engine powered by deep learning☆144Updated this week
- On-device AI recipes for building private, real-time applications with production-grade voice, language, and vision SDKs. Ready-to-use, o…☆114Updated this week
- On-device Speech-to-Index engine powered by deep learning☆36Apr 16, 2025Updated last year
- On-device speaker recognition engine powered by deep learning☆57Updated this week
- On-device noise suppression powered by deep learning☆93Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Voice activity engine benchmark framework☆23Jan 14, 2026Updated 7 months ago
- On-device speaker diarization powered by deep learning☆77Updated this week
- Implementation of different noise embeddings for noise aware training of Kaldi acoustic models.☆13Feb 13, 2021Updated 5 years ago
- A Ollama client for Android!☆90May 6, 2024Updated 2 years ago
- Speaker diarization benchmark framework☆45Jul 17, 2026Updated last month
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Jul 28, 2026Updated 3 weeks ago
- Vector search with MongoDB Atlas and Google Cloud☆17Apr 23, 2026Updated 3 months ago
- On-device Speech-to-Intent engine powered by deep learning☆706Updated this week
- A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.☆36May 11, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- On-device streaming speech-to-text engine powered by deep learning☆670Updated this week
- ☆37Jan 6, 2026Updated 7 months ago
- Browse, search, and visualize ONNX models.☆36May 6, 2025Updated last year
- An fully autonomous agent that accesses the browser and performs tasks.☆18Apr 25, 2025Updated last year
- On-device speech-to-text engine powered by deep learning☆483Updated this week
- WebAssembly binding for llama.cpp - Enabling on-browser LLM inference☆1,167Updated this week
- Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …☆38Jun 12, 2024Updated 2 years ago
- Lightweight Korean TTS Model based on FastSpeech2☆15Mar 4, 2026Updated 5 months ago
- a fast and lightweight distributed background task processing framework with seamless scheduling.☆15Mar 30, 2026Updated 4 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆18May 15, 2025Updated last year
- Simple Video Summarization using Text-to-Segment Anything (Florence2 + SAM2) This project provides a video processing tool that utilizes…☆10Feb 20, 2025Updated last year
- 33B Chinese LLM, DPO QLORA, 100K context, AirLLM 70B inference with single 4GB GPU☆14May 5, 2024Updated 2 years ago
- [Early Alpha] A unified framework for text-to-speech, voice conversion, automatic speech recognition, audio classification, voice activit…☆21Jan 10, 2025Updated last year
- A sleek, customizable interface for managing LLMs with responsive design and easy agent personalization.☆19Aug 30, 2024Updated last year
- A PyTorch framework for training transformer language models with Mixture of Experts (MoE) architecture support, Mixture of Depths (MoD),…☆21Updated this week
- Get aid from local LLMs right in your PowerShell☆17May 2, 2025Updated last year
- My hybrid TTS network that combines, VALL-E, VoiceBox, SpeechFlow, Seamless and TortoiseTTS into one☆26Aug 5, 2024Updated 2 years ago
- automatically quant GGUF models☆226Dec 23, 2025Updated 7 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- An attempt to reproduce CALM (Continuous Audio Language Models) using DACVAE as the audio VAE.☆19Feb 20, 2026Updated 5 months ago
- Modern UTF-8 aware C++ tokenizer with vocabulary support, ideal for NLP and transformer models. Header-only and zero-dependency.☆16Aug 7, 2025Updated last year
- MOLA implementations of the virtual state estimation API for robots / vehicles☆12Updated this week
- ☆12Sep 12, 2024Updated last year
- A high-performance batch audio transcription tool using nvidia/parakeet-tdt-0.6b-v2 to generate accurate, well-segmented SRT subtitles, w…☆18Dec 9, 2025Updated 8 months ago
- Run Orpheus 3B Locally With LM Studio☆32Mar 20, 2025Updated last year
- Code for "Error-driven Fixed-Budget ASR Personalization for Accented Speakers" in ICASSP 2021☆11Jun 13, 2021Updated 5 years ago