A framework for efficient model inference with omni-modality models
☆29Jul 12, 2026Updated last week
Alternatives and similar repositories for ht-vllm-omni
Users that are interested in ht-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆17Mar 20, 2026Updated 3 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆34Apr 20, 2026Updated 3 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆30Apr 30, 2025Updated last year
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Jul 11, 2026Updated last week
- Python app created with the purpose of speeding up and greatly facilitating the task of cleaning and adjusting Booru-style tags, aimed at…☆12Dec 2, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- 100.000 links, 50.000 artworks dataset. Includes source code that used to scrape data.☆10May 29, 2021Updated 5 years ago
- Data mapping framework for rust stuff☆56Mar 25, 2026Updated 3 months ago
- OhanashiGPT is an application that generates personalized children's stories based on parameters like age and preferences. It narrates th…☆13Sep 24, 2024Updated last year
- Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.☆181Updated this week
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 5 months ago
- Local modular AI assistant with speech, vision, and robotics support. Uses Qwen3-VL-4B in LM Studio.☆53Jan 9, 2026Updated 6 months ago
- A Multi-Agentic AI Assistant/Builder☆28Jun 1, 2026Updated last month
- ☆180Aug 10, 2025Updated 11 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Backup node_modules for all your npm based projects☆13Nov 29, 2016Updated 9 years ago
- A tool analyzing unused GPU code by machine learning workloads☆15Oct 6, 2025Updated 9 months ago
- a character-ai like UI for LLM☆10Dec 3, 2024Updated last year
- ☆42Feb 23, 2026Updated 4 months ago
- ☆13Oct 24, 2018Updated 7 years ago
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆18Feb 16, 2026Updated 5 months ago
- A simple QR code scanner as a progressive web application, works offline, no ads, no trackers, written in Preact and TypeScript.☆18Jun 5, 2025Updated last year
- ☆19Nov 3, 2021Updated 4 years ago
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆12Aug 17, 2024Updated last year
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- ☆27Jun 11, 2025Updated last year
- ⚠️ DEPRECATED - Use openclaw-true-recall-base instead☆31Mar 4, 2026Updated 4 months ago
- Port of Nordic Semiconductor nRF24L01 transceiver's Hardware Abstraction Layer API (NRF HAL) for the Arduino platform.☆11Jan 18, 2023Updated 3 years ago
- Docker images to use as base programming environments.☆13Updated this week
- Specialized fork for (relatively) fast single-GPU inference (in CUDA) using large MoE models that don't fit fully into VRAM☆17May 6, 2026Updated 2 months ago
- A Python toolkit for chain-of-thought prompting 🐍☆187Jul 5, 2026Updated 2 weeks ago
- Input text from speech in any Linux window, the lean, fast and accurate way, using whisper.cpp OFFLINE. Speak with local LLMs via llama.c…☆177Jul 25, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- High-performance K-line (Candlestick) chart for React Native, powered by Skia. Smooth, customizable, and built for real trading apps.☆19Mar 20, 2026Updated 3 months ago
- Electronic saxophone firmware and PCB☆17Feb 22, 2024Updated 2 years ago
- Compare websites performance!☆10Jun 2, 2021Updated 5 years ago
- A lightweight yet full-featured package for handling events from the terminal.☆12Aug 21, 2023Updated 2 years ago
- arduino library for Honeywell pressure sensors☆12May 4, 2020Updated 6 years ago
- A dynamic tiled window management that bridges the gap between yabai and krohnkite☆13Mar 13, 2025Updated last year
- ☆35Updated this week