antoyang / VidChapters
[NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scale
☆171Updated 10 months ago
Related projects: ⓘ
- [NeurIPS 2023] Self-Chained Image-Language Model for Video Localization and Question Answering☆175Updated 8 months ago
- [NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models☆153Updated 11 months ago
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Models☆282Updated 3 months ago
- [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"☆127Updated last year
- Code release for "EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone" [ICCV, 2023]☆85Updated 2 months ago
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆235Updated 8 months ago
- Awesome papers & datasets specifically focused on long-term videos.☆157Updated 2 months ago
- Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"☆81Updated 5 months ago
- [CVPR 2023] Official repository of paper titled "Fine-tuned CLIP models are efficient video learners".☆240Updated 5 months ago
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".☆205Updated 3 months ago
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)☆88Updated 10 months ago
- An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"☆127Updated 5 months ago
- MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions☆147Updated 10 months ago
- Code and Model for VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset☆231Updated 6 months ago
- ☆199Updated 5 months ago
- Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval [ICCV'21]☆342Updated 2 years ago
- Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆254Updated 3 months ago
- ☆61Updated 9 months ago
- Official Implementation of "The Surprising Effectiveness of Multimodal Large Language Models for Video Moment Retrieval"☆34Updated last month
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding☆188Updated last month
- Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Gr…☆109Updated 3 weeks ago
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆260Updated 5 months ago
- [CVPR 2024] TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding☆267Updated 3 months ago
- [ICCV2023] UniVTG: Towards Unified Video-Language Temporal Grounding☆314Updated 4 months ago
- ☆100Updated last year
- [NeurIPS2022] Egocentric Video-Language Pretraining☆222Updated 4 months ago
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆80Updated 2 months ago
- ☆101Updated 5 months ago
- Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)☆71Updated last month
- (2024CVPR) MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding☆211Updated 2 months ago