Deploy OmniVoice TTS model using TRT-LLM and Triton Inference Server on Modal.
☆18May 29, 2026Updated 4 months ago
Alternatives and similar repositories for omnivoice-trtllm
Users that are interested in omnivoice-trtllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton kernel fusion & CUDA Graph optimization for OmniVoice inference — RMSNorm, SwiGLU, Norm+Residual, SageAttention☆63Jul 20, 2026Updated 2 months ago
- [NeurIPS 2024] Official Code for the Paper OoD-ViT-NAS: Vision Transformer Neural Architecture Search for Out-of-Distribution Generalizat…☆15Dec 3, 2024Updated last year
- Browser-based text-to-speech powered by OmniVoice. Runs entirely locally via WebGPU and WebAssembly.☆17Jul 2, 2026Updated 3 months ago
- A boilerplate to use multiprocessing for your gRPC server in your Python project☆25Sep 14, 2021Updated 5 years ago
- ☆11Nov 15, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- OpenAI-compatible HTTP server for OmniVoice text-to-speech☆89Aug 31, 2026Updated last month
- [WACV2025] source code of StrDA: https://arxiv.org/abs/2410.09913☆20Apr 15, 2025Updated last year
- ☆83May 4, 2024Updated 2 years ago
- A simple and powerful tool for building Large Language Models from scratch【从零训练大模型】☆19Sep 29, 2025Updated last year
- ☆22May 2, 2026Updated 5 months ago
- Qwen3-TTS with nano vLLM-style optimizations for fast text-to-speech generation. Achieved 3x faster☆138Mar 3, 2026Updated 7 months ago
- Using open-source LLM Llama2 by Meta on local CPU inference for document question-and-answer☆15Oct 5, 2023Updated 2 years ago
- Example scripts for using [my] fine-tuned CLIP models with HuggingFace 🤗☆14Sep 24, 2024Updated 2 years ago
- an API server for indextts, allowing simple access without need to integrate actual code into your project☆18Oct 29, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 🔊Replicate Cog'ified MMAudio🎵☆18Jul 10, 2025Updated last year
- ☆40Jul 15, 2025Updated last year
- An example implementation of the SpecDiff descriptor for facial spoofing detection. The original paper was accepted to IJCB2020 and won t…☆12Feb 1, 2021Updated 5 years ago
- Visualising Losses in Deep Neural Networks☆16Jul 17, 2024Updated 2 years ago