patrick-tssn / VSTAR
[ACL2023] VSTAR is a multimodal dialogue dataset with scene and topic transition information
☆12Updated 3 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for VSTAR
- ☆55Updated 6 months ago
- Scanning Only Once: An End-to-end Framework for Fast Temporal Grounding in Long Videos☆20Updated 4 months ago
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)☆95Updated last year
- ☆72Updated 6 months ago
- ☆54Updated 4 months ago
- [CVPR 2023] VoP: Text-Video Co-operative Prompt Tuning for Cross-Modal Retrieval☆38Updated last year
- Official implementation of HawkEye: Training Video-Text LLMs for Grounding Text in Videos☆34Updated 6 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆52Updated 2 months ago
- NExT-QA: Next Phase of Question-Answering to Explaining Temporal Actions (CVPR'21)☆131Updated 3 months ago
- Source code of our MM'22 paper Partially Relevant Video Retrieval☆51Updated 2 weeks ago
- VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)☆22Updated 4 months ago
- ☆17Updated 4 months ago
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆116Updated last year
- [CVPR'23 Highlight] AutoAD: Movie Description in Context.☆88Updated 2 weeks ago
- A PyTorch implementation of EmpiricalMVM☆39Updated 11 months ago
- [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation☆48Updated last year
- 🌀 R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding (ECCV 2024)☆63Updated 4 months ago
- Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"☆40Updated 4 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆89Updated last week
- ☆30Updated 2 months ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆41Updated 2 months ago
- Contrastive Video Question Answering via Video Graph Transformer (IEEE T-PAMI'23)☆17Updated 8 months ago
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆178Updated 10 months ago
- Official repository for the A-OKVQA dataset☆64Updated 6 months ago
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆130Updated last year
- Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners☆112Updated 2 years ago
- Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model☆39Updated last year
- FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …☆96Updated 4 months ago
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning☆35Updated 3 months ago
- [ICCV 2023] Accurate and Fast Compressed Video Captioning☆34Updated 9 months ago