Alternatives and similar repositories for WeMix-LLM:

Users that are interested in WeMix-LLM are comparing it to the libraries listed below

• will-singularity / Skywork-MM
  Empirical Study Towards Building An Effective Multi-Modal Large Language Model
  ☆22Updated last year
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆42Updated 10 months ago
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆38Updated 10 months ago
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆47Updated 4 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆41Updated 3 weeks ago
• RhapsodyAILab / MiniCPM-V-Embedding
  ☆29Updated 8 months ago
• 360CVGroup / 360VL
  Our 2nd-gen LMM
  ☆33Updated 11 months ago
• mlfoundations / VisIT-Bench
  ☆51Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated 10 months ago
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆82Updated last year
• TIGER-AI-Lab / VisualWebInstruct
  The official repo for "VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search"
  ☆24Updated this week
• FudanNLPLAB / MouSi
  ☆73Updated last year
• thunlp / Muffin
  ☆63Updated last year
• RUCAIBox / Virgo
  Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*
  ☆100Updated 2 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• allenai / pixmo-docs
  Synthetic data generation pipelines for text-rich images.
  ☆63Updated 2 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆119Updated 5 months ago
• EvolvingLMMs-Lab / VideoMMMU
  ☆43Updated last month
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆56Updated 3 weeks ago
• MonolithFoundation / Bumblebee
  A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.
  ☆37Updated 8 months ago
• QwenLM / online_merging_optimizers
  Implementations of online merging optimizers proposed by Online Merging Optimizers for Boosting Rewards and Mitigating Tax in Alignment
  ☆75Updated 10 months ago
• Zheng0428 / COIG-Kun
  ☆36Updated 8 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆89Updated 7 months ago
• jdf-prog / LLM-Engines
  ☆46Updated 2 weeks ago
• pkunlp-icler / PCA-EVAL
  [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
  ☆102Updated last year
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆76Updated last year
• cofe-ai / FLM-101B
  ☆12Updated last year
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆111Updated last month
• fxmeng / mixtral_spliter
  Converting Mixtral-8x7B to Mixtral-[1~7]x7B
  ☆22Updated last year