A framework for efficient model inference with omni-modality models
☆30Oct 1, 2026Updated last week
Alternatives and similar repositories for ht-vllm-omni
Users that are interested in ht-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 6 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆31Sep 13, 2026Updated 3 weeks ago
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Sep 6, 2026Updated last month
- An example repo full of Douglas Adams quotes☆16Mar 12, 2024Updated 2 years ago
- Python app created with the purpose of speeding up and greatly facilitating the task of cleaning and adjusting Booru-style tags, aimed at…☆12Dec 2, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- Data mapping framework for rust stuff☆60Mar 25, 2026Updated 6 months ago
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Feb 21, 2025Updated last year
- OhanashiGPT is an application that generates personalized children's stories based on parameters like age and preferences. It narrates th…☆13Sep 24, 2024Updated 2 years ago
- Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.☆232Sep 6, 2026Updated last month
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 7 months ago
- Local modular AI assistant with speech, vision, and robotics support. Uses Qwen3-VL-4B in LM Studio.☆54Jan 9, 2026Updated 8 months ago
- ☆180Aug 10, 2025Updated last year
- An open-source, graph-based workflow engine for Gemini/OpenCode/Claude Code/Qwen CLI. Automate ML experiments and scientific discovery.☆41Apr 17, 2026Updated 5 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A tool analyzing unused GPU code by machine learning workloads☆15Oct 6, 2025Updated last year
- Fastest Open Source TTS Model☆95Aug 12, 2026Updated last month
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- GPU-accelerated voice assistant — local LLM, fine-tuned Whisper, Kokoro TTS, AMD ROCm☆25Apr 2, 2026Updated 6 months ago
- ☆43Feb 23, 2026Updated 7 months ago
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 7 months ago
- Automated parameter sweep pipeline for finding optimal sampling settings for any local LLM on quantized weights☆22Feb 21, 2026Updated 7 months ago
- ☆19Nov 3, 2021Updated 4 years ago
- ☆12Aug 17, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆27Jun 11, 2025Updated last year
- Port of Nordic Semiconductor nRF24L01 transceiver's Hardware Abstraction Layer API (NRF HAL) for the Arduino platform.☆11Jan 18, 2023Updated 3 years ago
- Docker images to use as base programming environments.☆13Updated this week
- Easy Images captioning under a good pyqt GUI☆21Jun 18, 2023Updated 3 years ago
- arduino library for Honeywell pressure sensors☆12May 4, 2020Updated 6 years ago
- A lightweight yet full-featured package for handling events from the terminal.☆12Aug 21, 2023Updated 3 years ago
- Quick and dirty API to control JIMU robots over bluethoot☆15May 31, 2021Updated 5 years ago
- ☆42Jul 13, 2026Updated 2 months ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Sep 22, 2026Updated 2 weeks ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Sep 28, 2026Updated last week
- Translate your large PDF files with ease using the power of Large Language Models!☆23Sep 8, 2025Updated last year
- A C-based checksec without readelf or grep dependance.☆11Apr 20, 2021Updated 5 years ago
- A simple yet faithful library to emulate different Enigma machines models using Python☆17Jul 31, 2026Updated 2 months ago
- The non-user-of-rawdraw-facing side of rawdraw.☆12Jan 12, 2021Updated 5 years ago
- A PHP RQL Parsing Library☆17Jan 28, 2025Updated last year
- Simple gaze tracking in python that uses an gradient-based algorithm by Timm & Barth to locate iris centers☆11Jul 16, 2015Updated 11 years ago