a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
☆38Apr 7, 2025Updated last year
Alternatives and similar repositories for OpenOmniNexus
Users that are interested in OpenOmniNexus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆17Apr 2, 2025Updated last year
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆22Apr 10, 2026Updated last month
- [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information☆16Oct 27, 2024Updated last year
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆139Nov 8, 2025Updated 6 months ago
- [CVPR Findings 2026] Official implementation of "RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectification"☆31Apr 10, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Quick Long Video Understanding [TMLR2025]☆78Oct 27, 2025Updated 6 months ago
- ☆45Apr 2, 2025Updated last year
- Arabic Grapheme-to-Phoneme (G2P) Conversion☆13Mar 15, 2025Updated last year
- Neural Homomorphic Vocoder optimized for singing voice synthesis☆33May 2, 2026Updated last week
- finetune llm part for spark-tts model☆122Mar 25, 2025Updated last year
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆22Oct 10, 2024Updated last year
- A lightweight, efficient variation of the StyleTTS 2 text‐to‐speech model.☆51May 22, 2025Updated 11 months ago
- Official Repository of LatentSeek☆82Jun 6, 2025Updated 11 months ago
- Drax: Speech Recognition with Discrete Flow Matching☆75Oct 15, 2025Updated 6 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆51Sep 3, 2025Updated 8 months ago
- No-Caffeine-No-Gain's Deep Knowledge Tracing (DKT)☆16Jul 29, 2021Updated 4 years ago
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆47Mar 3, 2025Updated last year
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆378May 27, 2025Updated 11 months ago
- ☆35Oct 23, 2025Updated 6 months ago
- This is now the official location of the Kaldi project.☆10Aug 22, 2019Updated 6 years ago
- ☆22Apr 6, 2025Updated last year
- Code for Retrieval-Augmented Perception （ICML 2025)☆69Apr 22, 2026Updated 2 weeks ago
- Streamable Text-to-Speech model using a language modeling approach, without vector quantization☆110May 20, 2025Updated 11 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Real-time Speech-Text Foundation Model Toolkit (wip)☆257Mar 26, 2025Updated last year
- [EMNLP 2024] A Video Chat Agent with Temporal Prior☆33Mar 2, 2025Updated last year
- An official implementation of Style-Talker for Spoken Dialogue Generation☆23Jan 12, 2025Updated last year
- 智联云城市水位监控系统（硬件+前后端+AI接入）☆12Sep 22, 2022Updated 3 years ago
- A Framework for Speech, Language, Audio, Music Processing with Large Language Model☆1,029Jan 15, 2026Updated 3 months ago
- A small rust-based data loader☆37Feb 20, 2026Updated 2 months ago
- Collection of works for evaluating (and analyzing) large audio-language models (LALMs)☆40Aug 11, 2025Updated 8 months ago
- The official implementation of InfoRM [NeurIPS 2024].☆15Oct 25, 2025Updated 6 months ago
- Vero: An Open RL Recipe for General Visual Reasoning☆116Apr 19, 2026Updated 2 weeks ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Whisper Speaker Identification (WSI), a cutting-edge model for multilingual speaker identification.☆26Mar 17, 2025Updated last year
- Full Text Search Over Probabilistic Lattices with Elasticsearch!☆10Nov 20, 2020Updated 5 years ago
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆106Mar 14, 2025Updated last year
- ☆82Jan 22, 2025Updated last year
- ☆10Oct 28, 2020Updated 5 years ago
- Unofficial PyTorch Implementation of "Were RNNs All We Needed?"☆17Mar 20, 2025Updated last year
- ☆14Jan 17, 2023Updated 3 years ago