VectorSpaceLab / Video-XL
π₯π₯First-ever hour scale video understanding models
β234Updated last month
Alternatives and similar repositories for Video-XL:
Users that are interested in Video-XL are comparing it to the libraries listed below
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"β162Updated last month
- Long Context Transfer from Language to Visionβ360Updated 3 months ago
- β351Updated 3 months ago
- Valley is a cutting-edge multimodal large model designed to handle a variety of tasks involving text, images, and video data.β212Updated last week
- Official repository for the paper PLLaVAβ637Updated 6 months ago
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingβ302Updated last week
- β78Updated 9 months ago
- This is the official implementation of our paper "Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension"β114Updated 3 weeks ago
- β174Updated 7 months ago
- [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Modelβ316Updated 3 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with gβ¦β284Updated this week
- Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)β155Updated 6 months ago
- β134Updated last month
- Multimodal Models in Real Worldβ437Updated 3 months ago
- β173Updated 7 months ago
- Official code for Goldfish model for long video understanding and MiniGPT4-video for short video understandingβ588Updated 2 months ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)β170Updated 2 months ago
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelsβ202Updated 5 months ago
- β¨β¨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysisβ460Updated 2 months ago
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textβ309Updated 3 months ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizerβ210Updated 10 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Enginesβ114Updated 3 months ago
- β170Updated 2 weeks ago
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captionsβ196Updated 7 months ago
- Explore the Limits of Omni-modal Pretraining at Scaleβ96Updated 5 months ago
- [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgeβ130Updated 7 months ago
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingβ258Updated 6 months ago
- Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundiβ¦β47Updated last year
- π₯π₯MLVU: Multi-task Long Video Understanding Benchmarkβ175Updated this week
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".β250Updated 8 months ago