NVlabs / OmniVinciLinks
OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.
☆620Updated 2 months ago
Alternatives and similar repositories for OmniVinci
Users that are interested in OmniVinci are comparing it to the libraries listed below
Sorting:
- AudioStory: Generating Long-Form Narrative Audio with Large Language Models☆294Updated 3 months ago
- StreamingVLM: Real-Time Understanding for Infinite Video Streams☆810Updated 2 months ago
- This is the official repo for the paper "LongCat-Flash-Omni Technical Report"☆451Updated 3 weeks ago
- ☆78Updated 8 months ago
- An open-source implementation of Whisper☆470Updated 2 months ago
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆568Updated 2 months ago
- ☆592Updated 2 weeks ago
- video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…☆136Updated 2 weeks ago
- MiMo-VL☆616Updated 4 months ago
- HunyuanImage-2.1: An Efficient Diffusion Model for High-Resolution (2K) Text-to-Image Generation☆665Updated 2 months ago
- Fully Open Framework for Democratized Multimodal Training☆679Updated 2 weeks ago
- A Scientific Multimodal Foundation Model☆625Updated 3 months ago
- Official repository for "VideoPrism: A Foundational Visual Encoder for Video Understanding" (ICML 2024)☆342Updated 3 months ago
- ☆184Updated 11 months ago
- Official implementation of "Continuous Autoregressive Language Models"☆684Updated last month
- An official implementation of "CapRL: Stimulating Dense Image Caption Capabilities via Reinforcement Learning"☆169Updated 2 weeks ago
- DACVAE☆184Updated 2 weeks ago
- ☆462Updated 2 weeks ago
- LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale (CVPR 2025)☆360Updated 2 months ago
- Liquid Audio - Speech-to-Speech audio models by Liquid AI☆331Updated this week
- Official implementation of "Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMs".☆96Updated 2 months ago
- WeDLM: The fastest diffusion language model with standard causal attention and native KV cache compatibility, delivering real speedups ov…☆480Updated last week
- Tiny Model, Big Logic: Diversity-Driven Optimization Elicits Large-Model Reasoning Ability in VibeThinker-1.5B☆559Updated last month
- A reproduction of the Deepseek-OCR model including training☆201Updated last month
- LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM☆292Updated 7 months ago
- The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"☆549Updated 3 weeks ago
- NextFlow🚀: Unified Sequential Modeling Activates Multimodal Understanding and Generation☆128Updated this week
- [ArXiv 2025] DiffusionVL: Translating Any Autoregressive Models into Diffusion Vision Language Models☆121Updated 2 weeks ago
- ☆440Updated last month
- Kyutai with an "eye"☆232Updated 9 months ago