Alternatives and similar repositories for LAVIS-XInstructBLIP

Users that are interested in LAVIS-XInstructBLIP are comparing it to the libraries listed below

• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated 2 years ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated 2 years ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated 2 years ago
• Nicous20 / FunQA
  FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …
  ☆104Updated this week
• alibaba / conv-llava
  ☆124Updated last year
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆120Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆67Updated last year
• Hritikbansal / videocon
  ☆58Updated last year
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆181Updated last year
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆168Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• imagegridworth / IG-VLM
  ☆140Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆147Updated last year
• QQ-MM / Video-CCAM
  A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.
  ☆74Updated last year
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆92Updated 3 weeks ago
• bigai-nlco / VideoLLaMB
  [ICCV 2025] Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆80Updated 10 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆127Updated 8 months ago
• thunlp / Muffin
  ☆66Updated last year
• TXH-mercury / COSA
  [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  ☆43Updated last year
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆164Updated last year
• yangjie-cv / WeThink
  WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning
  ☆36Updated 6 months ago
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆64Updated 5 months ago
• callsys / TextVR
  [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension
  ☆28Updated 2 years ago
• rxtan2 / Koala-video-llm
  ☆36Updated last year
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆153Updated 3 months ago
• showlab / cosmo
  ☆73Updated last year