patrick-tssn / VSTAR
[ACL2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information
☆12Updated 2 months ago
Alternatives and similar repositories for VSTAR:
Users that are interested in VSTAR are comparing it to the libraries listed below
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)☆97Updated last year
- Narrative movie understanding benchmark☆63Updated 8 months ago
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆184Updated last year
- ☆55Updated 8 months ago
- ☆63Updated last month
- NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)☆139Updated 5 months ago
- 🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)☆63Updated last year
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆95Updated 2 months ago
- ☆17Updated 6 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆48Updated 4 months ago
- A Unified Framework for Video-Language Understanding☆56Updated last year
- 🌀 R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding (ECCV 2024)☆71Updated 6 months ago
- Official implementation of HawkEye: Training Video-Text LLMs for Grounding Text in Videos☆36Updated 8 months ago
- Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videos☆22Updated 6 months ago
- ☆72Updated 8 months ago
- ☆134Updated 2 months ago
- Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners☆113Updated 2 years ago
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆131Updated last year
- A PyTorch implementation of EmpiricalMVM☆39Updated last year
- [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation☆47Updated last year
- ☆105Updated 2 years ago
- ☆32Updated 4 months ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆25Updated 6 months ago
- Source code of our MM'22 paper Partially Relevant Video Retrieval☆52Updated 2 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆56Updated 4 months ago
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆91Updated 2 months ago
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆83Updated 5 months ago
- [CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval☆38Updated last year
- Official pytorch repository for "Knowing Where to Focus: Event-aware Transformer for Video Grounding" (ICCV 2023)☆49Updated last year
- ☆28Updated 2 months ago