OmniInteract: Benchmarking Real-World Streaming Interaction for Real-Time Omnimodal Assistants
☆24May 30, 2026Updated 5 months ago
Alternatives and similar repositories for OmniInteract
Users that are interested in OmniInteract are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- OmniPro: A Comprehensive Benchmark for Omni-Proactive Streaming Video Understanding☆21Jul 27, 2026Updated 3 months ago
- Official Repo of "$X$-Stream: Exploring MLLMs as Multiplexers for Multi-Stream Understanding"☆36Jun 18, 2026Updated 4 months ago
- [ICML2026] OmniSIFT: Modality-Asymmetric Token Compression for Efficient Omni-modal Large Language Models☆31May 21, 2026Updated 5 months ago
- ☆14May 11, 2026Updated 6 months ago
- ☆15May 19, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ACL 2026 Oral] Official code, UIQ benchmark, and pretrained checkpoints for "Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Aud…☆12May 18, 2026Updated 5 months ago
- ☆136Jun 5, 2026Updated 5 months ago
- ☆12Sep 26, 2025Updated last year
- TBD☆12Sep 14, 2024Updated 2 years ago
- Extending context length of visual language models☆12Dec 18, 2024Updated last year
- [ACL 2026] Dual-Axis Generative Reward Model Toward Semantic and Turn-taking Robustness in Interactive Spoken Dialogue Models☆22May 23, 2026Updated 5 months ago
- MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocols☆20Nov 19, 2025Updated 11 months ago
- OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewe…☆86Sep 18, 2026Updated last month
- ICLR 2026 Oral: WAVE: Learning Unified & Versatile Audio-Visual Embeddings with Multimodal LLM☆53Jul 30, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs☆43Oct 3, 2026Updated last month
- [EMNLP 2026 Main]OmniReasoner: Thinking with Long Audio-Video via Native Tool Use☆39Jul 22, 2026Updated 3 months ago
- The official repo for Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation☆69Jul 2, 2025Updated last year
- This is the official repository of Daily-Omni: Towards Audio-Visual Reasoning with Temporal Alignment across Modalities☆54Oct 26, 2026Updated 2 weeks ago
- Official implementation of "Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Sound". IEEE TASLP 20…☆19Feb 27, 2026Updated 8 months ago
- ☆27Aug 14, 2025Updated last year
- ☆17Oct 21, 2026Updated 3 weeks ago
- This repo is the official implementation of "Stage-adaptive Token Selection for Efficient Omni-modal LLMs"☆20Oct 11, 2026Updated last month
- ☆16Oct 24, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆20Apr 2, 2025Updated last year
- The Source Code for OmniVideoBench @ICLR 2026☆80Feb 12, 2026Updated 8 months ago
- Code release for "Strike a Balance in Continual Panoptic Segmentation" (ECCV 2024)☆14Mar 14, 2025Updated last year
- OmniEvalKit is an evaluation framework designed for omni-modal large language models, with a focus on audio and audio-visual understandin…☆14Mar 27, 2026Updated 7 months ago
- [ICML2026]Efficient Post-Training of MLLMs for Temporal Video Grounding via On-Policy Distillation☆23Jun 29, 2026Updated 4 months ago
- Official code for MotionBench (CVPR 2025)☆82Mar 3, 2025Updated last year
- [ICML 2026] Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions☆62Jun 29, 2026Updated 4 months ago
- F-16 is a powerful video large language model (LLM) that perceives high-frame-rate videos, which is developed by the Department of Electr…☆44Jul 3, 2025Updated last year
- Repo for Paper: Towards Robust Speaker Recognition against Intrinsic Variation with Foundation Model Few-shot Tuning and Effective Speech…☆11Sep 24, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [NeurIPS 2025] Watch and Listen: Understanding Audio-Visual-Speech Moments with Multimodal LLM☆27Aug 27, 2026Updated 2 months ago
- MVU-Eval @NeurIPS DB 2025☆16Nov 11, 2025Updated last year
- fd-sds☆23Apr 8, 2026Updated 7 months ago
- A tools to estimate SMPL-X parameters (with T pose) from FLAME meshes (or FLAME parameters)☆22Nov 21, 2024Updated last year
- RISE: Reliable Improvement in Self-Evolving Vision-Language Models☆24Jun 12, 2026Updated 4 months ago
- Code release for "Saving 100x Storage: Prototype Replay for Reconstructing Training Sample Distribution in Class-Incremental Semantic Seg…☆20Mar 19, 2025Updated last year
- A novel benchmerk specially designed to evaluate Omni-LLMs under assistant-style, real-time video chat scenarios.☆34Aug 24, 2026Updated 2 months ago
Are these results useful?