Alternatives and similar repositories for OmniBind:

Users that are interested in OmniBind are comparing it to the libraries listed below

• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 4 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆47Updated 8 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆40Updated last week
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆17Updated 6 months ago
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆35Updated 10 months ago
• Share14 / ShareGemini
  ☆30Updated 8 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆40Updated 3 weeks ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆49Updated 5 months ago
• AV-Odyssey / AV-Odyssey
  This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"
  ☆23Updated 3 months ago
• SliMM-X / CoMP-MM
  Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"
  ☆23Updated 2 weeks ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆57Updated 6 months ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆38Updated 4 months ago
• JaaackHongggg / WorldSense
  WorldSense: Evaluating Real-world Omnimodal Understanding for Multimodal LLMs
  ☆20Updated this week
• RenShuhuai-Andy / NBP
  Official implementation of Next Block Prediction: Video Generation via Semi-Autoregressive Modeling
  ☆31Updated 2 months ago
• yaolinli / DeCo
  ☆34Updated 9 months ago
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆57Updated 4 months ago
• Yui010206 / CREMA
  [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆41Updated 3 months ago
• rese1f / aurora
  [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
  ☆93Updated last week
• bigai-nlco / VideoLLaMB
  Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges
  ☆66Updated last month
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆52Updated last week
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆28Updated 3 weeks ago
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆69Updated 7 months ago
• showlab / MovieSeq
  [ECCV 2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆37Updated last month
• DeepLearnXMU / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆28Updated 6 months ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• OpenGVLab / PVC
  [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
  ☆36Updated last month
• si0wang / VisVM
  ☆40Updated 3 months ago
• eric-ai-lab / MMWorld
  Official repo of the ICLR 2025 paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆25Updated 7 months ago
• sterzhang / PVIT
  Official Repository of Personalized Visual Instruct Tuning
  ☆28Updated last month