JoyAI-VL-Interaction: An Open Real-time Video-Language Interaction System
☆2,022Nov 4, 2026Updated this week
Alternatives and similar repositories for JoyAI-VL-Interaction
Users that are interested in JoyAI-VL-Interaction are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆25Jun 12, 2026Updated 4 months ago
- ☆156Apr 27, 2026Updated 6 months ago
- ☆136Jun 5, 2026Updated 5 months ago
- Streaming Video Instruction Tuning☆95Feb 25, 2026Updated 8 months ago
- 📚 A curated collection of papers and open-source code repositories dedicated to the application of Vision-Language Models (VLMs) for str…☆216Oct 30, 2026Updated last week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- An open-weight 11B model series for long-form and real-time video understanding☆819Oct 14, 2026Updated 3 weeks ago
- ☆1,776Updated this week
- JoyAI-Echo-1.5: Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds☆2,071Updated this week
- Codec-Aligned Sparsity as a Foundational Principle for Multimodal Intelligence☆404Updated this week
- Fully Open Framework for Democratized Multimodal Training☆1,230Updated this week
- 🔥🔥🔥 [Awesome] Latest Papers, Codes & Datasets on Streaming / Online Video Understanding — Building Always-on, Real-time Video AI 🤖☆490Oct 27, 2026Updated last week
- Implementation of Em_Garde: a proposal-retrieval framework for streaming video understanding☆36Oct 17, 2026Updated 2 weeks ago
- ☆45Sep 17, 2026Updated last month
- VideoJev: System One Model for Video Understanding and Interaction☆294Oct 18, 2026Updated 2 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- VideoChat3: a generalist video MLLM built for fine-grained motion, long-form reasoning, temporal grounding, and online proactive response…☆361Oct 2, 2026Updated last month
- StreamingVLM: Real-Time Understanding for Infinite Video Streams☆1,108Oct 15, 2025Updated last year
- [ACM MM 2025] TimeChat-online: 80% Visual Tokens are Naturally Redundant in Streaming Videos☆135Jun 29, 2026Updated 4 months ago
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆173Jul 24, 2025Updated last year
- OneStreamer: Unifying Perception, Memory, and Proactive Response in Streaming Video Interaction☆243Oct 14, 2026Updated 3 weeks ago
- A simple video streaming baseline that outperforms SOTAs.☆176May 1, 2026Updated 6 months ago
- ☆1,474Feb 12, 2026Updated 8 months ago
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆114Mar 14, 2025Updated last year
- [ICLR 2026] An official implementation of "STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence"☆47Apr 19, 2026Updated 6 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆20Apr 2, 2025Updated last year
- Official implementation of Open-o3-Video-v2.☆29Oct 14, 2026Updated 3 weeks ago
- [CVPR 2025]Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction☆185Aug 14, 2026Updated 2 months ago
- [NeurIPS 2026] Official implementation of "SetCon: Towards Open-Ended Referring Segmentation via Set-Level Concept Prediction"☆20Updated this week
- Qwen3-omni is a natively end-to-end, omni-modal LLM developed by the Qwen team at Alibaba Cloud, capable of understanding text, audio, im…☆4,095Apr 23, 2026Updated 6 months ago
- [NeurIPS 2026] ParaVT: Taming the Tool Prior Paradox for Parallel Tool Use in Agentic Video Reinforcement Learning☆57Oct 8, 2026Updated 3 weeks ago
- Resources and paper list for "Thinking with Images for LVLMs". This repository accompanies our survey on how LVLMs can leverage visual in…☆1,518Oct 8, 2026Updated 3 weeks ago
- ProactiveBench: A Comprehensive Benchmark for VideoLLM Proactive Interaction Evaluation☆21Jan 8, 2026Updated 9 months ago
- [ICML 2025 Oral] An official implementation of VideoRoPE & VideoRoPE++☆224Apr 15, 2026Updated 6 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- JoyAI-Image is the unified multimodal foundation model for image understanding, text-to-image generation, and instruction-guided image ed…☆2,238Aug 5, 2026Updated 3 months ago
- [CVPR 2025] OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts☆30Jul 14, 2026Updated 3 months ago
- ☆148Jul 26, 2026Updated 3 months ago
- [ICLR 2026] MMDuet2: Enhancing Proactive Interaction of Video MLLMs with Multi-Turn Reinforcement Learning☆48Jan 14, 2026Updated 9 months ago
- OmniAgent (ICML 2026): the first native omni-modal agent for active video perception — a 7B agent that beats Qwen2.5-VL-72B with 73% fewe…☆86Sep 18, 2026Updated last month
- WorldReward & WorldReward-Bench☆32Sep 7, 2026Updated 2 months ago
- See, hear, and interact on your local devices.☆27,081Oct 30, 2026Updated last week