A framework for efficient model inference with omni-modality models
☆29Sep 3, 2026Updated 2 weeks ago
Alternatives and similar repositories for ht-vllm-omni
Users that are interested in ht-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 5 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆36Apr 20, 2026Updated 4 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆31Updated this week
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Sep 6, 2026Updated last week
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- 100.000 links, 50.000 artworks dataset. Includes source code that used to scrape data.☆10May 29, 2021Updated 5 years ago
- Same as sqlite-tag but without the native sqlite3 module dependency☆19Feb 21, 2025Updated last year
- OhanashiGPT is an application that generates personalized children's stories based on parameters like age and preferences. It narrates th…☆13Sep 24, 2024Updated last year
- Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.☆230Sep 6, 2026Updated last week
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆16Feb 17, 2026Updated 7 months ago
- A Multi-Agentic AI Assistant/Builder☆28Jun 1, 2026Updated 3 months ago
- Local modular AI assistant with speech, vision, and robotics support. Uses Qwen3-VL-4B in LM Studio.☆54Jan 9, 2026Updated 8 months ago
- Load png/jpg/tga/webp on all browser with emscripten☆19Mar 4, 2013Updated 13 years ago
- ☆179Aug 10, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Backup node_modules for all your npm based projects☆13Nov 29, 2016Updated 9 years ago
- A tool analyzing unused GPU code by machine learning workloads☆15Oct 6, 2025Updated 11 months ago
- Comics Dataset Framework for Comics Understanding☆43Sep 1, 2025Updated last year
- ☆43Feb 23, 2026Updated 6 months ago
- ☆13Oct 24, 2018Updated 7 years ago
- A TTS model capable of generating ultra-realistic dialogue in one pass.☆32May 1, 2025Updated last year
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 7 months ago
- ☆19Nov 3, 2021Updated 4 years ago
- extension for pdfmake☆13Jul 5, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆23May 26, 2023Updated 3 years ago
- ☆27Jun 11, 2025Updated last year
- 🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs☆110Jun 25, 2025Updated last year
- Docker images to use as base programming environments.☆13Sep 9, 2026Updated last week
- Electronic saxophone firmware and PCB☆17Feb 22, 2024Updated 2 years ago
- High-performance K-line (Candlestick) chart for React Native, powered by Skia. Smooth, customizable, and built for real trading apps.☆20Mar 20, 2026Updated 5 months ago
- Compare websites performance!☆10Jun 2, 2021Updated 5 years ago
- Quick and dirty API to control JIMU robots over bluethoot☆14May 31, 2021Updated 5 years ago
- ☆42Jul 13, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Very simplistic chrome extension to save tab groups as sessions. Export/Import sessions as JSON files.☆15Sep 7, 2021Updated 5 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Aug 15, 2026Updated last month
- fdroid-dl is a python based f-droid mirror generation and update utility for the command line☆12Jul 2, 2020Updated 6 years ago
- Beautify HTML, JS, CSS, and JSON in the browser or in Node.js!☆10Jul 24, 2026Updated last month
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Sep 3, 2026Updated 2 weeks ago
- Translate your large PDF files with ease using the power of Large Language Models!☆23Sep 8, 2025Updated last year
- The non-user-of-rawdraw-facing side of rawdraw.☆12Jan 12, 2021Updated 5 years ago