Alternatives and similar repositories for LAVIS-XInstructBLIP

Users that are interested in LAVIS-XInstructBLIP are comparing it to the libraries listed below

• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• isekai-portal / Link-Context-Learning
  ☆99Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• Nicous20 / FunQA
  FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …
  ☆104Updated 11 months ago
• imagegridworth / IG-VLM
  ☆139Updated last year
• yangjie-cv / WeThink
  WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning
  ☆35Updated 5 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆180Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆168Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆94Updated last year
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆89Updated 5 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated last year
• invictus717 / MiCo
  [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale
  ☆118Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆125Updated 7 months ago
• alibaba / conv-llava
  ☆123Updated last year
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆38Updated 3 weeks ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• FudanNLPLAB / MouSi
  ☆75Updated last year
• om-ai-lab / ZoomEye
  [EMNLP-2025 Oral] ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆60Updated 2 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆64Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆66Updated last year
• Hritikbansal / videocon
  ☆57Updated last year
• rxtan2 / Koala-video-llm
  ☆36Updated last year
• thunlp / Muffin
  ☆66Updated last year
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆40Updated 8 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 9 months ago
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆36Updated last year