kkahatapitiya / LangRepo
Language Repository for Long Video Understanding
☆27Updated 3 months ago
Related projects: ⓘ
- Multimodal Video Understanding Framework (MVU)☆23Updated 4 months ago
- ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆24Updated 3 months ago
- Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆44Updated 2 months ago
- ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback☆39Updated last week
- ☆29Updated 2 months ago
- Explore VLM-Eval, a framework for evaluating Video Large Language Models, enhancing your video analysis with cutting-edge AI technology.☆22Updated 7 months ago
- Official implementation for "A Simple LLM Framework for Long-Range Video Question-Answering"☆81Updated 5 months ago
- Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.☆49Updated this week
- Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)☆27Updated 3 months ago
- ☆53Updated 2 months ago
- Official repo of the paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"☆19Updated this week
- Egocentric Video Understanding Dataset (EVUD)☆19Updated 2 months ago
- [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …☆75Updated 2 weeks ago
- [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''☆67Updated 5 months ago
- Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".☆32Updated 6 months ago
- Ego4D Goal-Step: Toward Hierarchical Understanding of Procedural Activities (NeurIPS 2023)☆35Updated 5 months ago
- Official Dataloader and Evaluation Scripts for LongVideoBench.☆52Updated last month
- [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding☆44Updated 8 months ago
- Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"☆68Updated last month
- [Arxiv] Calibrated Self-Rewarding Vision Language Models☆35Updated 3 months ago
- Code release for the paper "Egocentric Video Task Translation" (CVPR 2023 Highlight)☆31Updated last year
- ☆61Updated 9 months ago
- Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges☆27Updated this week
- ☆19Updated last month
- [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.☆20Updated 4 months ago
- Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆40Updated 10 months ago
- [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"☆99Updated 10 months ago
- ☆43Updated 2 months ago
- ☆49Updated last month
- Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)☆71Updated last month