Alternatives and similar repositories for LAVIS-XInstructBLIP:

Users that are interested in LAVIS-XInstructBLIP are comparing it to the libraries listed below

• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆52Updated this week
• TXH-mercury / COSA
  [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
  ☆43Updated 3 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆57Updated 10 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated last year
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆69Updated 2 months ago
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 6 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 4 months ago
• opendatalab / CLIP-Parrot-Bias
  ECCV2024_Parrot Captions Teach CLIP to Spot Text
  ☆65Updated 7 months ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆38Updated last month
• rxtan2 / Koala-video-llm
  ☆33Updated 7 months ago
• callsys / TextVR
  [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension
  ☆26Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆35Updated 10 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆91Updated 9 months ago
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆56Updated last year
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆70Updated this week
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆110Updated 2 weeks ago
• Hritikbansal / videocon
  ☆57Updated 11 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆64Updated 7 months ago
• Share14 / ShareGemini
  ☆30Updated 8 months ago
• isekai-portal / Link-Context-Learning
  ☆97Updated 11 months ago
• DCDmllm / Momentor
  ☆71Updated 4 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆39Updated 3 weeks ago
• WHB139426 / Grounded-Video-LLM
  Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
  ☆101Updated 3 weeks ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated last month
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆35Updated 8 months ago
• PolyU-ChenLab / ETBench
  👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)
  ☆57Updated 2 months ago