scofield7419 / Video-of-Thought

Related projects: ⓘ

• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆21Updated 3 months ago
• RERV / UniAdapter
  [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …
  ☆68Updated 7 months ago
• Share14 / ShareGemini
  ☆19Updated last month
• 360CVGroup / Inner-Adaptor-Architecture
  ☆28Updated 2 weeks ago
• palchenli / VL-Instruction-Tuning
  ☆83Updated 9 months ago
• foundation-multimodal-models / CAL
  Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆44Updated 3 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆67Updated 5 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆54Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆39Updated last week
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆58Updated 7 months ago
• HJYao00 / DenseConnector
  Dense Connector for MLLMs
  ☆98Updated last month
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆42Updated 3 months ago
• joez17 / ChatBridge
  ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without rely…
  ☆46Updated last year
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆18Updated last month
• DCDmllm / Momentor
  ☆43Updated 2 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆75Updated 2 weeks ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆25Updated last month
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆24Updated 3 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆36Updated last year
• YiyangZhou / CSR
  [Arxiv] Calibrated Self-Rewarding Vision Language Models
  ☆35Updated 3 months ago
• wxh1996 / VideoAgent
  ☆29Updated 2 months ago
• longvideobench / LongVideoBench
  Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆52Updated last month
• Yxxxb / VoCo-LLaMA
  VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆73Updated 2 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆44Updated 3 weeks ago
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆55Updated 4 months ago
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆21Updated 2 months ago
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆34Updated last month
• ChenDelong1999 / polite-flamingo
  🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)
  ☆63Updated 9 months ago
• yaolinli / DeCo
  ☆11Updated 2 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated last month