line / lighthouse
[EMNLP2024 Demo], [ICASSP 2025] A user-friendly library for reproducible video moment retrieval and highlight detection. It also supports audio moment retrieval.
β134Updated last week
Alternatives and similar repositories for lighthouse:
Users that are interested in lighthouse are comparing it to the libraries listed below
- [CVPR 2024] Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detectionβ86Updated 8 months ago
- π R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding (ECCV 2024)β80Updated 8 months ago
- Official pytorch repository for CG-DETR "Correlation-guided Query-Dependency Calibration in Video Representation Learning for Temporal Grβ¦β127Updated 7 months ago
- Official Implementation of "Chrono: A Simple Blueprint for Representing Time in MLLMs"β83Updated 3 weeks ago
- β70Updated 3 weeks ago
- [ECCVβ24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarioβ¦β52Updated 6 months ago
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understandingβ265Updated this week
- Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelsβ97Updated last week
- β169Updated 5 months ago
- [CVPR'2024 Highlight] Official PyTorch implementation of the paper "VTimeLLM: Empower LLM to Grasp Video Moments".β264Updated 9 months ago
- β132Updated 6 months ago
- [AAAI 2025] VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Groundingβ96Updated 3 months ago
- β182Updated 8 months ago
- [NeurIPS 2023 D&B] VidChapters-7M: Video Chapters at Scaleβ189Updated last year
- This is the official implementation of "Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streams"β175Updated 3 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.β125Updated 2 months ago
- [ICCV 2023] DiffusionRet: Generative Text-Video Retrieval with Diffusion Modelβ129Updated 11 months ago
- Supercharged BLIP-2 that can handle videosβ117Updated last year
- [ICCV 2023] UniVTG: Towards Unified Video-Language Temporal Groundingβ345Updated 10 months ago
- Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"β102Updated last month
- Official pytorch repository for "QD-DETR : Query-Dependent Video Representation for Moment Retrieval and Highlight Detection" (CVPR 2023 β¦β224Updated last year
- VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingβ378Updated this week
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)β100Updated 2 months ago
- [ICCV2023 Oral] Unmasked Teacher: Towards Training-Efficient Video Foundation Modelsβ322Updated 10 months ago
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Modelsβ256Updated last year
- [CVPR2024] The official implementation of AdaTAD: End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framesβ34Updated 8 months ago
- EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Propertiesβ122Updated 4 months ago
- Narrative movie understanding benchmarkβ69Updated 10 months ago
- [NeurIPS 2024] VidProM: A Million-scale Real Prompt-Gallery Dataset for Text-to-Video Diffusion Modelsβ137Updated 6 months ago
- β366Updated last month