alibaba / alimama-video-narratorLinks
Research code for ACL2024 paper: "Synchronized Video Storytelling: Generating Video Narrations with Structured Storyline"
☆31Updated 5 months ago
Alternatives and similar repositories for alimama-video-narrator
Users that are interested in alimama-video-narrator are comparing it to the libraries listed below
Sorting:
- ☆186Updated 10 months ago
- ☆76Updated 2 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆115Updated 2 months ago
- ☆148Updated 4 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆132Updated 4 months ago
- Repository for 23'MM accepted paper "Curriculum-Listener: Consistency- and Complementarity-Aware Audio-Enhanced Temporal Sentence Groundi…☆49Updated last year
- [NeurIPS 2024 D&B Track] Official Repo for "LVD-2M: A Long-take Video Dataset with Temporally Dense Captions"☆59Updated 7 months ago
- ☆175Updated this week
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆107Updated last month
- ☆133Updated last year
- [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions☆221Updated 11 months ago
- Ming - facilitating advanced multimodal understanding and generation capabilities built upon the Ling LLM.☆122Updated this week
- official repo for "VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation" [EMNLP2024]☆88Updated 3 months ago
- LVBench: An Extreme Long Video Understanding Benchmark☆90Updated 9 months ago
- FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …☆101Updated 5 months ago
- ☆147Updated 7 months ago
- Long Context Transfer from Language to Vision☆378Updated 2 months ago
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆94Updated 11 months ago
- Official repository of MMDU dataset☆91Updated 8 months ago
- Narrative movie understanding benchmark☆70Updated last year
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"☆181Updated 5 months ago
- The official repo for "Vidi: Large Multimodal Models for Video Understanding and Editing"☆100Updated last month
- ☆64Updated 9 months ago
- A Large-scale Dataset for training and evaluating model's ability on Dense Text Image Generation☆69Updated 3 months ago
- Official implementation of the paper "Koala-36M: A Large-scale Video Dataset Improving Consistency between Fine-grained Conditions and Vi…☆176Updated 2 months ago
- [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale☆208Updated last year
- ☆87Updated 11 months ago
- Supercharged BLIP-2 that can handle videos☆118Updated last year
- Explore the Limits of Omni-modal Pretraining at Scale☆102Updated 9 months ago
- VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning☆140Updated 3 weeks ago