Alternatives and similar repositories for PaLM2-VAdapter

Users that are interested in PaLM2-VAdapter are comparing it to the libraries listed below

• LAION-AI / General-GPT
  ☆65Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 6 months ago
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆46Updated 2 years ago
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆23Updated 3 weeks ago
• ml-jku / semantic-image-text-alignment
  ☆24Updated 2 years ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• jmerullo / limber
  https://arxiv.org/abs/2209.15162
  ☆51Updated 2 years ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆113Updated 7 months ago
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆60Updated 10 months ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆32Updated 10 months ago
• lucasjinreal / ImageTokenizer
  imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…
  ☆35Updated last year
• DCDmllm / HyperLLaVA
  Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models
  ☆28Updated last year
• DCDmllm / MorphTokens
  ☆44Updated last year
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated last year
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆43Updated last year
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆26Updated 3 months ago
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆74Updated 11 months ago
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆46Updated 5 months ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆34Updated last year
• allenai / grit_official
  Official repository for the General Robust Image Task (GRIT) Benchmark
  ☆54Updated 2 years ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆48Updated last month
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆48Updated 9 months ago
• facebookresearch / SIEVE
  SIEVE: Multimodal Dataset Pruning using Image-Captioning Models (CVPR 2024)
  ☆16Updated last year
• Qichuzyy / POA
  Official implementation of ECCV24 paper: POA
  ☆24Updated last year
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆23Updated 8 months ago
• OliverRensu / D-iGPT
  [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…
  ☆98Updated last year
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 9 months ago
• TomerRonen34 / mixed-resolution-vit
  ☆51Updated last year