A framework for efficient model inference with omni-modality models
☆30Nov 8, 2026Updated last week
Alternatives and similar repositories for ht-vllm-omni
Users that are interested in ht-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆11Sep 9, 2026Updated 2 months ago
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 7 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆36Apr 20, 2026Updated 6 months ago
- Probe any HTTP server for OpenAI API compliance, with an honest matrix of how the OSS implementations actually behave.☆17Nov 8, 2026Updated last week
- A sample pattern for running CI tests on Modal☆21Apr 12, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Feb 5, 2022Updated 4 years ago
- TNE-SDK - The Official Python SDK for The Null Epoch - an AI-only MMO where LLMs play autonomously. Connect any model (OpenAI, Anthropic,…☆14Oct 30, 2026Updated 2 weeks ago
- A curated list of vintage large language models — also called historical or time-capsule LLMs — trained from scratch on text from bounded…☆49May 9, 2026Updated 6 months ago
- AI tool for the creation of animation sprite sheet, ComfyUI back end and Minimax H3 and WAN 2.2 support☆22Sep 27, 2026Updated last month
- Turn any character image into a looping animated sprite (moving SVG, WebP & GIF) with Google's Nano Banana 2 (gemini-3.1-flash-image) — a…☆15Jun 29, 2026Updated 4 months ago
- Explorations into the proposed SDFT, Self-Distillation Enables Continual Learning, from Shenfeld et al. of MIT☆33Feb 6, 2026Updated 9 months ago
- ☆31Jan 7, 2026Updated 10 months ago
- An example repo full of Douglas Adams quotes☆16Mar 12, 2024Updated 2 years ago
- Scripts to setup a two-node llama.cpp cluster on NVIDIA DGX Spark (GB10) hardware.☆12May 10, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The all-in-one AI assistant for development and content creation☆16Aug 12, 2026Updated 3 months ago
- Open-source American english TTS model. 6 voices and a high performance inference library for Apple Silicon.☆18May 20, 2026Updated 5 months ago
- nagi-llm is a modern evolution of the NAGI interpreter, enhanced with AI and LLM-driven scripting.☆14Dec 17, 2025Updated 11 months ago
- ☆14May 8, 2026Updated 6 months ago
- Boot straight into AI. UEFI application — no OS required.☆17Oct 28, 2026Updated 3 weeks ago
- Conveniently export torch.compile compiled products into self-contained Python files☆35Jun 5, 2026Updated 5 months ago
- BMO - Local Ai companion☆33Feb 26, 2026Updated 8 months ago
- ☆31Oct 22, 2025Updated last year
- Visegrad+ Parliament API. Access to parliament data of Visegrad+ countries in a common data standard.☆11May 17, 2016Updated 10 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- Zero-shot clone-tuner for Kokoro-82M. Generate stock-compatible custom voice packs from 5-seconds of reference audio in less than 1-secon…☆28Nov 10, 2026Updated last week
- Adversarial Tokenization☆39Nov 21, 2025Updated 11 months ago
- ☆10Sep 1, 2020Updated 6 years ago
- One image in, one 3D Gaussian-splat .ply out. Self-hosted Docker service with a web gallery, 3D viewer, HTTP API and MCP server.☆24Nov 6, 2026Updated last week
- Activator trace instrumentation☆12Dec 4, 2014Updated 11 years ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆17Feb 17, 2026Updated 9 months ago
- Midi Host synthesizer using Teensy 4.1 and Audio Adapter board circuitry, compatible with Vyzex EWI4000s Editor.☆15May 13, 2026Updated 6 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- utilities for batched llm calls with retries☆55Updated this week
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Feb 21, 2025Updated last year
- Pressure testing the context window of open LLMs☆26Aug 25, 2024Updated 2 years ago
- Write data to web-audio☆11Mar 14, 2021Updated 5 years ago
- Windows GUI for building better Kokoro TTS voice outputs. Combines Kokoro voice random-walk search, target-audio scoring, RVC model train…☆14Aug 22, 2026Updated 2 months ago
- LLM-powered research knowledge base — compile raw documents into a living wiki with persistent agent memory and RAG retrieval.☆14Apr 5, 2026Updated 7 months ago
- ☆10May 18, 2024Updated 2 years ago
Are these results useful?