a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
☆39Apr 7, 2025Updated last year
Alternatives and similar repositories for OpenOmniNexus
Users that are interested in OpenOmniNexus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- llama-omni训练代码复现☆72Jan 23, 2025Updated last year
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆145May 9, 2026Updated 5 months ago
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆28Jul 14, 2026Updated 2 months ago
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆20Apr 2, 2025Updated last year
- ☆21Jun 4, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆282May 19, 2025Updated last year
- ☆52Apr 20, 2026Updated 5 months ago
- Meanflow and multilingual for F5-TTS model☆16Aug 23, 2025Updated last year
- Code for TranX-Adapter (ICML 2026)☆19Jun 3, 2026Updated 4 months ago
- ☆46Apr 2, 2025Updated last year
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆23Oct 10, 2024Updated last year
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110May 20, 2025Updated last year
- ☆125May 18, 2026Updated 4 months ago
- ☆33Jan 14, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The project for speech translation☆12Sep 28, 2023Updated 3 years ago
- Expression Snippet Transformer for Robust Video-based Facial Expression Recognition☆17Jan 27, 2024Updated 2 years ago
- [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information☆16Oct 27, 2024Updated last year
- A simple implementation for improving CosyVoice2 by GRPO method☆39May 5, 2026Updated 5 months ago
- ☆24May 25, 2026Updated 4 months ago
- steps to perform text-based speaker diarization with kaldi toolkit☆12Nov 2, 2018Updated 7 years ago
- ☆112Jul 15, 2026Updated 2 months ago
- Implementation of Transfer Learning from Speaker Verification to Multi-speaker Text-To-Speech Synthesis (SV2TTS) in Persian language.☆13Oct 2, 2025Updated last year
- Official implementation of paper: Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis☆56Sep 20, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A simple command line tool to calculate WER for ASR.☆15Jul 28, 2026Updated 2 months ago
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆400May 27, 2025Updated last year
- Code for CTC-TTS: LLM-based dual-streaming text-to-speech with CTC alignment, Interspeech 2026.☆22Aug 14, 2026Updated last month
- A collection of all our phonemeizers for dataset construction and inference☆32Feb 21, 2025Updated last year
- Streaming Vocos☆33Jun 10, 2025Updated last year
- ☆29Jul 22, 2026Updated 2 months ago
- An automatic prosodic boundary annotation tool for Text-to-Speech Synthesis (TTS).☆50Jun 11, 2024Updated 2 years ago
- DUSTED: Spoken-Term Discovery using Discrete Speech Units☆17Oct 2, 2024Updated 2 years ago
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆1,066Jan 15, 2026Updated 8 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Stream-Omni is a GPT-4o-like language-vision-speech chatbot that simultaneously supports interaction across various modality combinations…☆392Jun 17, 2025Updated last year
- ☆12May 30, 2025Updated last year
- Official repository for ICLR 2025 paper "Amulet: ReAlignment During Test Time for Personalized Preference Adaptation of LLMs"☆20Mar 18, 2025Updated last year
- ☆35Oct 23, 2025Updated 11 months ago
- [ACL 2026 Main] Training, inference, and testing of the SAC speech codec model.☆111Nov 1, 2025Updated 11 months ago
- Official code for "EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting"☆125Oct 16, 2025Updated 11 months ago
- Llasa Speed Up☆64Jan 18, 2026Updated 8 months ago