bytedance / Shot2Story
A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.
☆106Updated 3 months ago
Alternatives and similar repositories for Shot2Story:
Users that are interested in Shot2Story are comparing it to the libraries listed below
- ☆171Updated 6 months ago
- ☆64Updated last month
- ☆169Updated 6 months ago
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"☆148Updated 3 weeks ago
- Multimodal Models in Real World☆427Updated 2 months ago
- ☆132Updated this week
- ☆338Updated 2 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆95Updated 2 months ago
- Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"☆118Updated last month
- Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…☆46Updated last year
- InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions☆127Updated 11 months ago
- A simple script that reads a directory of videos, grabs a random frame, and automatically discovers a prompt for it☆133Updated 11 months ago
- [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Models☆127Updated 3 months ago
- EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties☆119Updated 2 months ago
- Tarsier -- a family of large-scale video-language models, which is designed to generate high-quality video descriptions , together with g…☆185Updated this week
- Official code for 'Paragraph-to-Image Generation with Information-Enriched Diffusion Model'☆102Updated last month
- 🔥🔥First-ever hour scale video understanding models☆223Updated 3 weeks ago
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding☆244Updated 5 months ago
- official implementation of VideoDirectorGPT: Consistent Multi-scene Video Generation via LLM-Guided Planning (COLM 2024)☆171Updated 5 months ago
- [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"☆134Updated 4 months ago
- Long Context Transfer from Language to Vision☆356Updated last month
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆248Updated last year
- [CVPR 2024] Intelligent Grimm - Open-ended Visual Storytelling via Latent Diffusion Models☆227Updated last month
- ☆145Updated last month
- Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"☆90Updated 5 months ago
- ☆130Updated 3 months ago
- Supercharged BLIP-2 that can handle videos☆118Updated last year
- ☆72Updated 8 months ago
- Code release for our NeurIPS 2024 Spotlight paper "GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing"☆97Updated 2 months ago