Alternatives and similar repositories for PaLM2-VAdapter

Users that are interested in PaLM2-VAdapter are comparing it to the libraries listed below

• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆27Updated last week
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆121Updated 11 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆49Updated 2 years ago
• ByungKwanLee / Phantom
  [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …
  ☆63Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated 2 years ago
• MCR-PEFT / Ex-MCR
  ☆45Updated 7 months ago
• LAION-AI / General-GPT
  ☆65Updated 2 years ago
• facebookresearch / HierVL
  [CVPR 2023] HierVL Learning Hierarchical Video-Language Embeddings
  ☆46Updated 2 years ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆61Updated last year
• kyegomez / Mirasol
  Pytorch Implementation of the Model from "MIRASOL3B: A MULTIMODAL AUTOREGRESSIVE MODEL FOR TIME-ALIGNED AND CONTEXTUAL MODALITIES"
  ☆26Updated 11 months ago
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆28Updated last year
• lucidrains / MaMMUT-pytorch
  Implementation of MaMMUT, a simple vision-encoder text-decoder architecture for multimodal tasks from Google, in Pytorch
  ☆103Updated 2 years ago
• kyegomez / TTL
  Pytorch Implementation of the paper: "Learning to (Learn at Test Time): RNNs with Expressive Hidden States"
  ☆25Updated 3 weeks ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated 2 years ago
• philippe-eecs / small-vision
  A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.
  ☆34Updated last year
• WangFei-2019 / SNARE
  Project for SNARE benchmark
  ☆11Updated last year
• locuslab / llava-token-compression
  ☆46Updated last year
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆69Updated 8 months ago
• jmerullo / limber
  https://arxiv.org/abs/2209.15162
  ☆53Updated 2 years ago
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆36Updated last year
• mshukor / ima-lmms
  [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs
  ☆22Updated last year
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆29Updated last year
• facebookresearch / VLaMP
  Code for “Pretrained Language Models as Visual Planners for Human Assistance”
  ☆61Updated 2 years ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆55Updated 6 months ago
• shulin16 / MMInA
  [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents
  ☆47Updated 10 months ago
• SHI-Labs / VisPer-LM
  [NeurIPS 2025] Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation
  ☆68Updated 2 months ago
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆46Updated last year
• Hritikbansal / videocon
  ☆58Updated last year
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated 2 years ago
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆105Updated 2 years ago