A framework for efficient model inference with omni-modality models
☆29Jul 12, 2026Updated 3 weeks ago
Alternatives and similar repositories for ht-vllm-omni
Users that are interested in ht-vllm-omni are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 4 months ago
- Generate a llama-quantize command to copy the quantization parameters of any GGUF☆36Apr 20, 2026Updated 3 months ago
- Locally hosted AI Agent Python Tool To Generate Novel Research Hypothesis + Titles + Abstracts☆30Apr 30, 2025Updated last year
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆15Jul 28, 2026Updated last week
- Python app created with the purpose of speeding up and greatly facilitating the task of cleaning and adjusting Booru-style tags, aimed at…☆12Dec 2, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- 100.000 links, 50.000 artworks dataset. Includes source code that used to scrape data.☆10May 29, 2021Updated 5 years ago
- OhanashiGPT is an application that generates personalized children's stories based on parameters like age and preferences. It narrates th…☆13Sep 24, 2024Updated last year
- Jacobian-Brainwash : A manual alignment tool for large language models built on Anthropic's Jacobian Lens. Results are exportable.☆213Aug 1, 2026Updated last week
- A Multi-Agentic AI Assistant/Builder☆28Jun 1, 2026Updated 2 months ago
- Load png/jpg/tga/webp on all browser with emscripten☆19Mar 4, 2013Updated 13 years ago
- ☆180Aug 10, 2025Updated 11 months ago
- Backup node_modules for all your npm based projects☆13Nov 29, 2016Updated 9 years ago
- An open-source, graph-based workflow engine for Gemini/OpenCode/Claude Code/Qwen CLI. Automate ML experiments and scientific discovery.☆40Apr 17, 2026Updated 3 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Fastest Open Source TTS Model☆80Jul 25, 2026Updated 2 weeks ago
- A tool analyzing unused GPU code by machine learning workloads☆15Oct 6, 2025Updated 10 months ago
- GPU-accelerated voice assistant — local LLM, fine-tuned Whisper, Kokoro TTS, AMD ROCm☆19Apr 2, 2026Updated 4 months ago
- ☆42Feb 23, 2026Updated 5 months ago
- Useful Nautilus Scripts made with☆13Jul 27, 2021Updated 5 years ago
- ☆24May 26, 2023Updated 3 years ago
- ☆12Aug 17, 2024Updated last year
- 🗣️ Real‑time, low‑latency voice, vision, and conversational‑memory AI assistant built on LiveKit and local LLMs☆112Jun 25, 2025Updated last year
- Docker images to use as base programming environments.☆13Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Electronic saxophone firmware and PCB☆17Feb 22, 2024Updated 2 years ago
- ☆39Jul 13, 2026Updated 3 weeks ago
- Fixes for the function keys sticking on the Framework Laptop☆12Jul 9, 2022Updated 4 years ago
- fdroid-dl is a python based f-droid mirror generation and update utility for the command line☆12Jul 2, 2020Updated 6 years ago
- Very simplistic chrome extension to save tab groups as sessions. Export/Import sessions as JSON files.☆15Sep 7, 2021Updated 4 years ago
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆32Apr 10, 2026Updated 3 months ago
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆88Updated this week
- Translate your large PDF files with ease using the power of Large Language Models!☆23Sep 8, 2025Updated 11 months ago
- TRELLIS.2 image-to-3D in C++/GGML (CUDA + Vulkan), with a resident HTTP server☆245Aug 1, 2026Updated last week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A simple yet faithful library to emulate different Enigma machines models using Python☆15Jul 31, 2026Updated last week
- A PHP RQL Parsing Library☆17Jan 28, 2025Updated last year
- ComfyUI-HiggsAudio is now available in ComfyUI, Higgs Audio v2 is a text-audio foundation model from Boson AI.☆23Jul 26, 2025Updated last year
- Modern file sync tool with delta transfers, 40-79% faster than rsync☆33Jul 30, 2026Updated last week
- Send images, captions and text to Telegram channels and DM's from comfyui☆12Apr 22, 2024Updated 2 years ago
- Sparse Inferencing for transformer based LLMs☆219Mar 25, 2026Updated 4 months ago
- REMI 3 "All-in-One" electronic wind instrument (EWI) - based on Teensy 3.2 MCU - Arduino IDE☆16Dec 18, 2023Updated 2 years ago