a fully open-source implementation of a GPT-4o-like speech-to-speech video understanding model.
☆38Apr 7, 2025Updated last year
Alternatives and similar repositories for OpenOmniNexus
Users that are interested in OpenOmniNexus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆18Apr 2, 2025Updated last year
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆23Apr 10, 2026Updated 2 months ago
- ☆276May 19, 2025Updated last year
- Expression Snippet Transformer for Robust Video-based Facial Expression Recognition☆17Jan 27, 2024Updated 2 years ago
- [ACL 2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information☆16Oct 27, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Mechanistic View on Video Generation as World Models: State and Dynamics☆53Jun 27, 2026Updated last week
- (NIPS 2025) OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Align…☆142May 9, 2026Updated 2 months ago
- ☆33Jan 14, 2023Updated 3 years ago
- [CVPR Findings 2026] Official implementation of "RectifiedHR: Enable Efficient High-Resolution Synthesis via Energy Rectification"☆31Apr 10, 2026Updated 2 months ago
- PyTorch Implementation of "Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Larg…☆49Mar 2, 2026Updated 4 months ago
- Quick Long Video Understanding [TMLR2025]☆79Oct 27, 2025Updated 8 months ago
- ☆46Apr 2, 2025Updated last year
- Speaker embedding for anime speech domain based on ECAPA_TDNN☆20Jun 22, 2025Updated last year
- 4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)☆13Feb 13, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆22Oct 10, 2024Updated last year
- In this project I used ML modeling and data analysis to predict ad clicks and significantly improve ad campaign performance, resulting in…☆13Nov 6, 2023Updated 2 years ago
- A lightweight, efficient variation of the StyleTTS 2 text‐to‐speech model.☆50May 22, 2025Updated last year
- Official Repository of LatentSeek☆83Jun 6, 2025Updated last year
- Drax: Speech Recognition with Discrete Flow Matching☆75Oct 15, 2025Updated 8 months ago
- Pytorch implementation for codes in Noise Imitation Based Adversarial Training for Robust Multimodal Sentiment Analysis (Accepted by IEEE…☆15Feb 2, 2024Updated 2 years ago
- ☆52Sep 3, 2025Updated 10 months ago
- No-Caffeine-No-Gain's Deep Knowledge Tracing (DKT)☆17Jul 29, 2021Updated 4 years ago
- We propose C2SER, a novel audio-language model designed to enhance the stability and accuracy of speech emotion recognition through conte…☆49Mar 3, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ✨✨Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM☆386May 27, 2025Updated last year
- Code for Retrieval-Augmented Perception （ICML 2025)☆72Apr 22, 2026Updated 2 months ago
- Real-time Speech-Text Foundation Model Toolkit (wip)☆257Mar 26, 2025Updated last year
- An official implementation of Style-Talker for Spoken Dialogue Generation☆23Jan 12, 2025Updated last year
- A small rust-based data loader☆36Feb 20, 2026Updated 4 months ago
- Collection of works for evaluating (and analyzing) large audio-language models (LALMs)☆41Aug 11, 2025Updated 10 months ago
- The official implementation of InfoRM [NeurIPS 2024].☆16Oct 25, 2025Updated 8 months ago
- Whisper Speaker Identification (WSI), a cutting-edge model for multilingual speaker identification.☆26Jun 29, 2026Updated last week
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆111Mar 14, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆81Jan 22, 2025Updated last year
- ☆10Oct 28, 2020Updated 5 years ago
- Unofficial PyTorch Implementation of "Were RNNs All We Needed?"☆17Mar 20, 2025Updated last year
- CVPR 2021 Oral Paper PatchGenCN☆11Oct 28, 2021Updated 4 years ago
- [Arxiv 2025] FlexPainter: Flexible and Multi-View Consistent Texture Generation☆43Dec 9, 2025Updated 7 months ago
- ArtSpeech: Adaptive Text-to-Speech Synthesis with Articulatory Representations☆21Sep 21, 2025Updated 9 months ago
- ☆15May 13, 2024Updated 2 years ago