High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.
☆27Oct 21, 2026Updated 3 weeks ago
Alternatives and similar repositories for vllm-omni-mlx
Users that are interested in vllm-omni-mlx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Copilot of JiusiServe sub repos☆19Updated this week
- community maintained vllm/vllm-omni style inference engine for system1 models in Rust for extreme efficient performance☆63Updated this week
- yuanrong-datasystem☆15May 25, 2026Updated 5 months ago
- vLLM based inference framework for agentic workload.☆108Updated this week
- This is the official **live** mirror of Huawei Ascend-native hardware plugin for ray☆16Oct 28, 2026Updated 2 weeks ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- 面向 AI 论文写作的多学科 Skill 包,支持 CS、医学和金融论文的规划、写作、润色、图表、引用核查与投稿前审查。☆23Jun 26, 2026Updated 4 months ago
- vLLM plugin for attention-ffn disaggregation support☆249Updated this week
- Build an easy-to-use workflow for the next generation of video creation with agent☆399Updated this week
- On-device simultaneous interpretation on Apple Silicon — VoxCPM2 on MLX at the core, streaming TTS in ~170 ms, voice clone, any-pair tran…☆16Sep 22, 2026Updated last month
- Large Language Model for Recipe Generation☆12Oct 2, 2024Updated 2 years ago
- Recursive Abstractive Processing for Tree-Organized Retrieval☆10May 30, 2024Updated 2 years ago
- Tool-use for Agents☆11Jul 14, 2025Updated last year
- ☆13Jun 20, 2026Updated 4 months ago
- An LLM post-training framework with vLLM for RL Scaling☆503Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆125Nov 6, 2026Updated last week
- Reproduction package for "Harness as a Language: A Minimalist Agent Framework With Maximal Expressivity" — ten agent arms across AppWorld…☆36Oct 10, 2026Updated last month
- Pytorch Code for---Knowledge-Level Consistency Reinforcement Learning: Dual-Fact Alignment for Long-Form Factuality.☆16Oct 13, 2025Updated last year
- Implementation of N-rep☆14Aug 11, 2025Updated last year
- A unified workflow orchestration and distributed KV cache sharing framework for multimodal inference.☆39Sep 4, 2026Updated 2 months ago
- calculate bhattacharyya distance based on zero cross rate feature between different Gaussian model for speech emotion recognition. corpus…☆11Oct 17, 2018Updated 8 years ago
- Fooling neural based speech recognition systems.☆14Jun 9, 2017Updated 9 years ago
- ☆15Mar 29, 2024Updated 2 years ago
- 🍙将日语转换成汉语的读法。空耳~~~☆11Oct 30, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [Archived] For the latest updates and community contribution, please visit: https://github.com/Ascend/TransferQueue or https://gitcode.co…☆15Aug 14, 2026Updated 3 months ago
- [EMNLP2026 Findings] TRAJDEBUG: Tracing Error Lifecycle to Identify Critical Failures in Long-Horizon Agent Trajectories☆21Sep 7, 2026Updated 2 months ago
- Gogs docker-compose☆15Jan 5, 2021Updated 5 years ago
- 将codex订阅转成gpt的api,轻量级适合自用☆42Apr 24, 2026Updated 6 months ago
- [ICML 2025] Efficiently Serving Large Multimodal Models Using EPD Disaggregation☆29Jul 11, 2026Updated 4 months ago
- ZET-Speech: Zero-shot adaptive Emotion-controllable Text-to-Speech Synthesis with Diffusion and Style-based Models (TTS)☆10Mar 9, 2024Updated 2 years ago
- Rainbow Keywords - Official PyTorch Implementation☆14Jun 27, 2024Updated 2 years ago
- ☆28Sep 22, 2026Updated last month
- Mel spectrum based on tacotron2 for melgan speech synthesis☆15Mar 24, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Official Pytorch Implementation for Continual Learning For On-Device Environmental Sound Classification☆14Jul 19, 2022Updated 4 years ago
- A framework for efficient model inference with omni-modality models☆7,792Updated this week
- ☆16Dec 23, 2021Updated 4 years ago
- A high level deep learning framework for quickly prototyping networks with added tools in data visualisation, model interpretability and …☆20May 17, 2023Updated 3 years ago
- Converts Mandarin Chinese pinyin notation to IPA (international phonetic alphabet) notation☆19Nov 28, 2023Updated 2 years ago
- Tensor Contraction Code Generator☆41Aug 14, 2017Updated 9 years ago
- ☆13Sep 15, 2026Updated 2 months ago
Are these results useful?