Alternatives and similar repositories for mllm-hd

Users that are interested in mllm-hd are comparing it to the libraries listed below

• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆136Updated last year
• SparksJoe / Prism
  A Framework for Decoupling and Assessing the Capabilities of VLMs
  ☆44Updated last year
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆62Updated 3 months ago
• icoz69 / StableLLAVA
  Official repo for StableLLAVA
  ☆95Updated last year
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆60Updated 9 months ago
• gpt4video / GPT4Video
  Offical Code for GPT4Video: A Unified Multimodal Large Language Model for lnstruction-Followed Understanding and Safety-Aware Generation
  ☆141Updated 8 months ago
• FudanNLPLAB / MouSi
  ☆73Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆111Updated 5 months ago
• agents-x-project / PyVision
  Official implementation of "PyVision: Agentic Vision with Dynamic Tooling."
  ☆24Updated last week
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 5 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• jialuli-luka / SELMA
  Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data
  ☆34Updated last year
• yfzhang114 / SliME
  ✨✨Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Models
  ☆159Updated 6 months ago
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆76Updated 7 months ago
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆151Updated last year
• LAION-AI / General-GPT
  ☆64Updated last year
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆143Updated 8 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆47Updated 8 months ago
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆46Updated 4 months ago
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆56Updated last year
• j-min / DSG
  Davidsonian Scene Graph (DSG) for Text-to-Image Evaluation (ICLR 2024)
  ☆90Updated 7 months ago
• 360CVGroup / Inner-Adaptor-Architecture
  LMM solved catastrophic forgetting, AAAI2025
  ☆44Updated 3 months ago
• MBZUAI-LLM / web2code
  Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs
  ☆85Updated 8 months ago
• apple / ml-mia-bench
  This repo contains code and data for ICLR 2025 paper MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs
  ☆31Updated 4 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆60Updated 4 months ago
• yeezhu / UNIT
  PyTorch implementation of "UNIT: Unifying Image and Text Recognition in One Vision Encoder", NeurlPS 2024.
  ☆30Updated 9 months ago
• sterzhang / image-textualization
  Image Textualization: An Automatic Framework for Generating Rich and Detailed Image Descriptions (NeurIPS 2024)
  ☆164Updated 11 months ago
• artemisp / LAVIS-XInstructBLIP
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆48Updated 11 months ago
• MetaStone-AI / MetaStone-S1
  The open-source code of MetaStone-S1.
  ☆29Updated last week
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆83Updated last year