zyayoung / Awesome-Video-LLMs

Related projects: ⓘ

• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆39Updated last week
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆67Updated 5 months ago
• kkahatapitiya / LangRepo
  Language Repository for Long Video Understanding
  ☆27Updated 3 months ago
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆49Updated this week
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆21Updated 2 months ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆24Updated 3 months ago
• wxh1996 / VideoAgent
  ☆29Updated 2 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆42Updated 3 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆54Updated last year
• DCDmllm / Momentor
  ☆43Updated 2 months ago
• Ziyang412 / VideoTree
  Code for paper "VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos"
  ☆68Updated last month
• MengLcool / DeepStack-VL
  ☆31Updated 3 months ago
• mrwu-mac / ControlMLLM
  Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆44Updated 3 weeks ago
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆34Updated last month
• bigai-nlco / VideoLLaMB
  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆27Updated this week
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆36Updated last year
• YiyangZhou / CSR
  [Arxiv] Calibrated Self-Rewarding Vision Language Models
  ☆35Updated 3 months ago
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆22Updated 3 months ago
• Share14 / ShareGemini
  ☆19Updated last month
• zhjohnchan / SK-VG
  [CVPR-2023] The official dataset of Advancing Visual Grounding with Scene Knowledge: Benchmark and Method.
  ☆28Updated last year
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆75Updated 5 months ago
• lezhang7 / Enhance-FineGrained
  [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding
  ☆35Updated last month
• HJYao00 / DenseConnector
  Dense Connector for MLLMs
  ☆98Updated last month
• showlab / cosmo
  ☆70Updated 4 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆32Updated last year
• longvideobench / LongVideoBench
  Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆52Updated last month
• Hon-Wong / Elysium
  [ECCV 2024] Elysium: Exploring Object-level Perception in Videos via MLLM
  ☆47Updated 2 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆44Updated 8 months ago
• heliossun / SQ-LLaVA
  Visual self-questioning for large vision-language assistant.
  ☆22Updated 3 weeks ago
• ziplab / LongVLM
  ☆49Updated last month