Omni inference in C/C++
☆315Oct 30, 2026Updated last week
Alternatives and similar repositories for llama.cpp-omni
Users that are interested in llama.cpp-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official PyTorch+CUDA Full-functional Web Demo for MiniCPM-o 4.5☆423Sep 15, 2026Updated last month
- Cook up amazing AI applications effortlessly with MiniCPM / MiniCPM-V / MiniCPM-o☆669Oct 26, 2026Updated last week
- Standalone C++ inference project for VoxCPM models built on top of ggml.☆97Jul 14, 2026Updated 3 months ago
- MiniCPM-V apps — fully offline multimodal chat on iOS / Android / HarmonyOS☆515Oct 29, 2026Updated last week
- A framework for efficient model inference with omni-modality models☆7,603Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- TTS support with GGML☆249Oct 5, 2025Updated last year
- Implementation of Qwen3-ASR-0.6B in GGML☆118Jul 28, 2026Updated 3 months ago
- Nano vLLM☆27Aug 11, 2025Updated last year
- Github repository for paper: Think Before You Talk: Enhancing Meaningful Dialogue Generation in Full-Duplex Speech Language Models with P…☆14Jun 15, 2026Updated 4 months ago
- Port of Facebook's LLaMA model in C/C++☆113Updated this week
- OpenMOSS pure C++ pipeline based on GGML☆76Sep 24, 2026Updated last month
- See, hear, and interact on your local devices.☆27,084Oct 30, 2026Updated last week
- An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, a…☆4,101Updated this week
- ☆251Jul 18, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants☆24May 30, 2026Updated 5 months ago
- ☆15May 19, 2026Updated 5 months ago
- Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++☆7,933Updated this week
- MLX Local Serving (MLS) - Unified ASR, TTS, and Translation on Apple Silicon☆17Jun 20, 2026Updated 4 months ago
- vllm混合推理扩展插件，支持多NUMA混合推理，单卡推理Qwen3-Next模型可达1000+ prefill☆34Nov 7, 2025Updated last year
- [ACL 2026] Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models☆22May 23, 2026Updated 5 months ago
- High Performance Serving Runtime For Interactive Super Intelligence System☆1,710Updated this week
- ☆42Jul 13, 2026Updated 3 months ago
- This project is for learning to convert onnx models from qwen2, and for running onnx model examples.☆12Oct 10, 2024Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A lightweight pure C++ Text-to-Speech (TTS) pipeline with OpenVINO, supporting multiple languages.☆113Sep 26, 2025Updated last year
- Local AI text-to-speech with voice cloning and voice design, powered by GGML. C++17 port of OmniVoice (k2-fsa/OmniVoice). 646 languages, …☆209Updated this week
- High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI☆620Updated this week
- a local-first desktop pet powered by MiniCPM5☆498Aug 18, 2026Updated 2 months ago
- 在kaggle部署ChatGLM API，和ChatGPT api使用相同的调用方式☆14Jun 30, 2023Updated 3 years ago
- Validate database backup files before migration to prevent costly failures☆14Aug 4, 2025Updated last year
- 🎙️ A 0.1B Omni model trained from scratch, capable of listening, speaking, and seeing!☆2,709Oct 27, 2026Updated last week
- Native full-duplex speech dialogue inference for BayLing-Duplex.☆96Jun 22, 2026Updated 4 months ago
- MiniCPM5: SOTA on-device LLMs, small yet powerful.☆11,820Sep 21, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- llama.cpp fork with additional SOTA quants and improved performance☆3,381Updated this week
- ☆27Aug 14, 2025Updated last year
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆682Jul 27, 2026Updated 3 months ago
- Qwen2.5-Omni is an end-to-end multimodal model by Qwen team at Alibaba Cloud, capable of understanding text, audio, vision, video, and pe…☆4,095Jun 12, 2025Updated last year
- ☆16Feb 29, 2024Updated 2 years ago
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆4,096Apr 23, 2026Updated 6 months ago