Alternatives and similar repositories for WeMM:

Users that are interested in WeMM are comparing it to the libraries listed below

• X2FD / LVIS-INSTRUCT4V
  ☆132Updated last year
• mynameischaos / Lion
  Lion: Kindling Vision Intelligence within Large Language Models
  ☆52Updated 11 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆80Updated 3 months ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆164Updated 6 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆251Updated 6 months ago
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆200Updated 10 months ago
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆128Updated 6 months ago
• OpenGVLab / MM-Interleaved
  MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer
  ☆210Updated 9 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆154Updated 3 months ago
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆130Updated last month
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated 10 months ago
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆302Updated 2 months ago
• thunlp / Muffin
  ☆59Updated 11 months ago
• baaivision / EVE
  [NeurIPS'24 Spotlight] EVE: Encoder-Free Vision-Language Models
  ☆261Updated 3 months ago
• OpenGVLab / MMT-Bench
  ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
  ☆96Updated 6 months ago
• x-cls / superclass
  [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training
  ☆192Updated this week
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆88Updated 6 months ago
• alipay / Ant-Multi-Modal-Framework
  Research Code for Multimodal-Cognition Team in Ant Group
  ☆131Updated 6 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆80Updated last year
• shufangxun / LLaVA-MoD
  Making LLaVA Tiny via MoE-Knowledge Distillation
  ☆77Updated last week
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆207Updated 2 months ago
• Beckschen / ViTamin
  [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"
  ☆196Updated 7 months ago
• alibaba / conv-llava
  ☆107Updated 5 months ago
• bytedance / Portrait-Mode-Video
  Video dataset dedicated to portrait-mode video recognition.
  ☆41Updated last month
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆143Updated 2 months ago
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆266Updated 10 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆134Updated 2 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆324Updated this week
• ShareGPT4Omni / ShareGPT4V
  [ECCV 2024] ShareGPT4V: Improving Large Multi-modal Models with Better Captions
  ☆187Updated 6 months ago
• OpenGVLab / MM-NIAH
  [NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of…
  ☆109Updated last month