Alternatives and similar repositories for LAVIS-XInstructBLIP

Users that are interested in LAVIS-XInstructBLIP are comparing it to the libraries listed below

• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆94Updated last year
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆94Updated last year
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆50Updated last year
• imagegridworth / IG-VLM
  ☆138Updated last year
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆177Updated 11 months ago
• foundation-multimodal-models / CAPTURE
  ☆76Updated last year
• alibaba / conv-llava
  ☆119Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆122Updated 6 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆63Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated last year
• QQ-MM / Video-CCAM
  A lightweight flexible Video-MLLM developed by TencentQQ Multimedia Research Team.
  ☆74Updated 11 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated 2 years ago
• thunlp / Muffin
  ☆65Updated last year
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 7 months ago
• xjtupanda / Sparrow
  Repo for paper "T2Vid: Translating Long Text into Multi-Image is the Catalyst for Video-LLMs"
  ☆49Updated last month
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆37Updated 6 months ago
• TencentARC / ST-LLM
  [ECCV 2024🔥] Official implementation of the paper "ST-LLM: Large Language Models Are Effective Temporal Learners"
  ☆150Updated last year
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated last year
• rxtan2 / Koala-video-llm
  ☆36Updated last year
• yangjie-cv / WeThink
  WeThink: Toward General-purpose Vision-Language Reasoning via Reinforcement Learning
  ☆35Updated 3 months ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆57Updated last year
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆86Updated last year
• zzxslp / SoM-LLaVA
  [COLM-2024] List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs
  ☆144Updated last year
• OpenGVLab / TPO
  Task Preference Optimization: Improving Multimodal Large Language Models with Vision Task Alignment
  ☆60Updated 2 months ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆47Updated 10 months ago
• showlab / cosmo
  ☆72Updated last year