a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
☆39Apr 7, 2025Updated last year
Alternatives and similar repositories for OpenOmniNexus
Users that are interested in OpenOmniNexus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama-omni训练代码复现☆72Jan 23, 2025Updated last year
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆145May 9, 2026Updated 5 months ago
- NAACL 2025 main conference: "VoiceTextBlender: Augmenting Large Language Models with Speech Capabilities via Single-Stage Joint Speech-Te…☆13Apr 27, 2025Updated last year
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆30Jul 14, 2026Updated 3 months ago
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆20Apr 2, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Traceable TTS: Toward Watermark-Free TTS with Strong Traceability☆13Sep 4, 2025Updated last year
- High-throughput batched ASR for NVIDIA GPUs. Run Zipformer and NVIDIA NeMo Parakeet models through one Python API with TensorRT, custom C…☆32Oct 7, 2026Updated 3 weeks ago
- ☆21Jun 4, 2026Updated 4 months ago
- ☆282May 19, 2025Updated last year
- ☆52Updated this week
- Meanflow and multilingual for F5-TTS model☆16Aug 23, 2025Updated last year
- ☆46Apr 2, 2025Updated last year
- ☆21Sep 4, 2026Updated last month
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆49Mar 3, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110May 20, 2025Updated last year
- ☆12Aug 12, 2025Updated last year
- ☆36Aug 13, 2026Updated 2 months ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆23Oct 10, 2024Updated 2 years ago
- ☆125May 18, 2026Updated 5 months ago
- OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding☆19Jul 27, 2026Updated 3 months ago
- [ACL 2026] DiTReducio: A Training-Free Acceleration for DiT-Based TTS viaProgressive Calibration☆14Apr 17, 2026Updated 6 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆254Mar 26, 2025Updated last year
- Code for TranX-Adapter (ICML 2026)☆19Jun 3, 2026Updated 4 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The project for speech translation☆12Sep 28, 2023Updated 3 years ago
- A simple implementation for improving CosyVoice2 by GRPO method☆39May 5, 2026Updated 5 months ago
- steps to perform text-based speaker diarization with kaldi toolkit☆12Nov 2, 2018Updated 7 years ago
- ☆34Jan 14, 2023Updated 3 years ago
- High-throughput Silero VAD inference for CPU with multi-window ONNX execution and an optimized RFFT frontend.☆18Jul 18, 2026Updated 3 months ago
- ☆17Oct 24, 2025Updated last year
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆403May 27, 2025Updated last year
- Implementation of Transfer Learning from Speaker Verification to Multi-speaker Text-To-Speech Synthesis (SV2TTS) in Persian language.☆13Oct 2, 2025Updated last year
- ☆23May 25, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Expression Snippet Transformer for Robust Video-based Facial Expression Recognition☆17Jan 27, 2024Updated 2 years ago
- End to End Speech to Speech with Emotion System☆15Feb 6, 2025Updated last year
- ☆113Jul 15, 2026Updated 3 months ago
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆56Sep 20, 2025Updated last year
- [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information☆16Oct 27, 2024Updated 2 years ago
- LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM☆313May 16, 2025Updated last year
- Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach☆15Oct 30, 2024Updated last year