Alternatives and similar repositories for WeMix-LLM

Users that are interested in WeMix-LLM are comparing it to the libraries listed below

• will-singularity / Skywork-MM
  Empirical Study Towards Building An Effective Multi-Modal Large Language Model
  ☆22Updated last year
• Zheng0428 / COIG-Kun
  ☆36Updated 10 months ago
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated last year
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year
• patrick-tssn / Awesome-Colorful-LLM
  Recent advancements propelled by large language models (LLMs), encompassing an array of domains including Vision, Audio, Agent, Robotics,…
  ☆123Updated last month
• OpenLMLab / scaling-rope
  code for Scaling Laws of RoPE-based Extrapolation
  ☆73Updated last year
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• SkyworkAI / Skywork-Reward-V2
  Scaling Preference Data Curation via Human-AI Synergy
  ☆69Updated last week
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• vaew / SkyScript-100M
  SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2
  ☆123Updated 7 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 6 months ago
• GAIR-NLP / ReAlign
  Reformatted Alignment
  ☆113Updated 9 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆85Updated 8 months ago
• RUC-AIMind / TikTalk
  ☆69Updated last month
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆50Updated 7 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 2 months ago
• RhapsodyAILab / MiniCPM-V-Embedding
  ☆29Updated 10 months ago
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• pkunlp-icler / PCA-EVAL
  [ACL 2024] PCA-Bench: Evaluating Multimodal Large Language Models in Perception-Cognition-Action Chain
  ☆105Updated last year
• gpt4video / GPT4Video
  Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
  ☆140Updated 8 months ago
• MileBench / MileBench
  This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"
  ☆35Updated last year
• FlagOpen / Infinity-Instruct
  ☆48Updated last year
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆266Updated last year
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆62Updated 3 months ago
• allenai / pixmo-docs
  ACL 2025: Synthetic data generation pipelines for text-rich images.
  ☆87Updated 4 months ago
• lucasjinreal / LLaVA-Magvit2
  LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.
  ☆37Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• nishiwen1214 / Benchmark-leakage-detection
  Official completion of “Training on the Benchmark Is Not All You Need”.
  ☆34Updated 6 months ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆135Updated last year