Alternatives and similar repositories for Inner-Adaptor-Architecture

Users that are interested in Inner-Adaptor-Architecture are comparing it to the libraries listed below

• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 7 months ago
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆55Updated 9 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆90Updated 7 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 9 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆111Updated last month
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆61Updated last week
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆99Updated 3 weeks ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• zehanwang01 / OmniBind
  ☆30Updated last month
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆24Updated 4 months ago
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆38Updated 10 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆75Updated 4 months ago
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆57Updated 3 months ago
• RenShuhuai-Andy / TESTA
  [EMNLP 2023] TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
  ☆50Updated last year
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆50Updated 6 months ago
• lzw-lzw / UnifiedMLLM
  UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model
  ☆22Updated 9 months ago
• si0wang / VisVM
  ☆41Updated 4 months ago
• John-AI-Lab / NoisyRollout
  NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
  ☆53Updated last week
• bigai-nlco / VideoLLaMB
  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆67Updated 2 months ago
• yuezih / Movie101
  Narrative movie understanding benchmark
  ☆70Updated last year
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆64Updated 8 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆35Updated 10 months ago
• bytedance / Portrait-Mode-Video
  Video dataset dedicated to portrait-mode video recognition.
  ☆48Updated 5 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆163Updated 7 months ago
• deepglint / UniME
  The official code of "Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs"
  ☆61Updated last week
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆44Updated 6 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆98Updated 8 months ago
• hshjerry / VideoEspresso
  [CVPR 2025 Oral] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection
  ☆75Updated last month