A framework for efficient model inference with omni-modality models
☆29Jul 12, 2026Updated last month
Alternatives and similar repositories for ht-vllm-omni
Users that are interested in ht-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 5 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆36Apr 20, 2026Updated 4 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆30Apr 30, 2025Updated last year
- An example repo full of Douglas Adams quotes☆16Mar 12, 2024Updated 2 years ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- BMO - Local Ai companion☆32Feb 26, 2026Updated 6 months ago
- Docker + CVE-2015-2925 = escaping from --volume☆11Jun 30, 2015Updated 11 years ago
- a smol tool for managing local models☆19May 31, 2026Updated 2 months ago
- OhanashiGPT is an application that generates personalized children's stories based on parameters like age and preferences. It narrates th…☆13Sep 24, 2024Updated last year
- Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.☆227Aug 1, 2026Updated 3 weeks ago
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 6 months ago
- A Multi-Agentic AI Assistant/Builder☆28Jun 1, 2026Updated 2 months ago
- Local modular AI assistant with speech, vision, and robotics support. Uses Qwen3-VL-4B in LM Studio.☆54Jan 9, 2026Updated 7 months ago
- Use the Google camera app with your own gallery app instead of Google photos☆24Dec 27, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An open-source, graph-based workflow engine for Gemini/OpenCode/Claude Code/Qwen CLI. Automate ML experiments and scientific discovery.☆40Apr 17, 2026Updated 4 months ago
- A tool analyzing unused GPU code by machine learning workloads☆15Oct 6, 2025Updated 10 months ago
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- GPU-accelerated voice assistant — local LLM, fine-tuned Whisper, Kokoro TTS, AMD ROCm☆25Apr 2, 2026Updated 4 months ago
- ☆43Feb 23, 2026Updated 6 months ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- [DEPRECATED] Prometheus exporter for VPA recommendations☆12Aug 22, 2023Updated 3 years ago
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆22Feb 16, 2026Updated 6 months ago
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Notes and slides for a course on social and scientific aspects of machine learning☆10Aug 1, 2026Updated 3 weeks ago
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 5 years ago
- Run llama.cpp server with Vulkan☆19Aug 5, 2026Updated 3 weeks ago
- 🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs☆111Jun 25, 2025Updated last year
- Detect and execute esoteric programming language code.☆14Jan 6, 2023Updated 3 years ago
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 3 months ago
- Electronic saxophone firmware and PCB☆17Feb 22, 2024Updated 2 years ago
- High-performance K-line (Candlestick) chart for React Native, powered by Skia. Smooth, customizable, and built for real trading apps.☆20Mar 20, 2026Updated 5 months ago
- arduino library for Honeywell pressure sensors☆12May 4, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Docker Volume Driver for distributed k/v stores☆11Feb 9, 2016Updated 10 years ago
- Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.c…☆177Jul 25, 2025Updated last year
- ☆42Jul 13, 2026Updated last month
- Norwegian question answering dataset☆15Feb 3, 2024Updated 2 years ago
- fdroid-dl is a python based f-droid mirror generation and update utility for the command line☆12Jul 2, 2020Updated 6 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Aug 15, 2026Updated 2 weeks ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week