Alternatives and similar repositories for VL-GPT

Users that are interested in VL-GPT are comparing it to the libraries listed below

• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆159Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆72Updated last year
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆137Updated 2 years ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆79Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated 2 years ago
• mightyzau / RegionBLIP
  ☆58Updated 2 years ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• ggjy / DeLVM
  ☆120Updated last year
• palchenli / VL-Instruction-Tuning
  ☆92Updated 2 years ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆213Updated last year
• foundation-multimodal-models / CAPTURE
  ☆82Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆147Updated last year
• Share14 / ShareGemini
  ☆32Updated last year
• si0wang / VisVM
  ☆46Updated last year
• jiyt17 / IDA-VLM
  [ICLR 2025] IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model
  ☆37Updated last year
• AFeng-x / Draw-and-Understand
  [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆93Updated 2 months ago
• Haochen-Wang409 / ross
  [ICLR'25] Reconstructive Visual Instruction Tuning
  ☆135Updated 10 months ago
• RUCAIBox / ComVint
  The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…
  ☆19Updated 2 years ago
• alibaba / conv-llava
  ☆124Updated last year
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆76Updated last year
• mightyzau / InfMLLM
  ☆19Updated 2 years ago
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression
  ☆65Updated 11 months ago
• bronyayang / Law_of_Vision_Representation_in_MLLMs
  [COLM'25] Official implementation of the Law of Vision Representation in MLLMs
  ☆176Updated 4 months ago
• xichenpan / Kosmos-G
  Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models
  ☆74Updated last year
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆37Updated 2 years ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆98Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated 2 years ago
• lxtGH / DenseWorld-1M
  Code and dataset link for "DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real World"
  ☆122Updated 4 months ago