VectorSpaceLab / Video-XL
π₯π₯First-ever hour scale video understanding models
β223Updated 3 weeks ago
Alternatives and similar repositories for Video-XL:
Users that are interested in Video-XL are comparing it to the libraries listed below
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"β148Updated 3 weeks ago
- Long Context Transfer from Language to Visionβ356Updated last month
- β338Updated 2 months ago
- Multimodal Models in Real Worldβ427Updated 2 months ago
- β171Updated 6 months ago
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelsβ195Updated 4 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Enginesβ106Updated 2 months ago
- [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Modelβ314Updated 2 months ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)β161Updated last month
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingβ244Updated 5 months ago
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captionsβ187Updated 6 months ago
- Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"β118Updated last month
- LVBench: An Extreme Long Video Understanding Benchmarkβ74Updated 4 months ago
- Explore the Limits of Omni-modal Pretraining at Scaleβ96Updated 4 months ago
- [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingβ324Updated last month
- β132Updated this week
- Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundiβ¦β46Updated last year
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingβ261Updated this week
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.β106Updated 3 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with gβ¦β185Updated this week
- β169Updated 6 months ago
- β¨β¨Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysisβ442Updated last month
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizerβ210Updated 9 months ago
- [ECCV 2024π₯] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"β134Updated 4 months ago
- Official repository for the paper PLLaVAβ630Updated 5 months ago
- Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)β152Updated 5 months ago
- β159Updated 6 months ago
- β76Updated 8 months ago
- OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Textβ302Updated 2 months ago