VectorSpaceLab / Video-XL
🔥🔥First-ever hour scale video understanding models
☆169Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for Video-XL
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"☆131Updated 3 months ago
- Long Context Transfer from Language to Vision☆334Updated this week
- ☆69Updated 6 months ago
- Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Engines☆89Updated 2 weeks ago
- ☆127Updated 3 weeks ago
- Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)☆145Updated 3 months ago
- LVBench: An Extreme Long Video Understanding Benchmark☆62Updated 2 months ago
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions☆157Updated 4 months ago
- ☆166Updated 4 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆217Updated 2 weeks ago
- ☆152Updated 4 months ago
- Explore the Limits of Omni-modal Pretraining at Scale☆89Updated 2 months ago
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆198Updated 7 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…☆146Updated 2 weeks ago
- [ACL 2024] GroundingGPT: Language-Enhanced Multi-modal Grounding Model☆303Updated 2 weeks ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆179Updated last month
- SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models☆177Updated 2 months ago
- PixelLM is an effective and efficient LMM for pixel-level reasoning and understanding. PixelLM is accepted by CVPR 2024.☆182Updated 5 months ago
- Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).☆148Updated last month
- ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models☆140Updated 2 weeks ago
- Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models☆64Updated last week
- [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models☆232Updated last month
- Multimodal Models in Real World☆404Updated 3 weeks ago
- ☆286Updated 2 weeks ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆132Updated last month
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆246Updated 4 months ago
- 🔥🔥MLVU: Multi-task Long Video Understanding Benchmark☆158Updated 3 weeks ago
- MuLan: Adapting Multilingual Diffusion Models for 110+ Languages (无需额外训练为任意扩散模型支持多语言能力)☆127Updated 5 months ago
- This is the official code of VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding (ECCV 2024)☆131Updated 2 months ago