Alternatives and similar repositories for MM-REACT

Users that are interested in MM-REACT are comparing it to the libraries listed below

• AILab-CVC / GPT4Tools
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…
  ☆773Updated 2 years ago
• lupantech / chameleon-llm
  Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
  ☆1,139Updated 2 years ago
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,518Updated 2 years ago
• yxuansu / PandaGPT
  [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All
  ☆845Updated 2 years ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆763Updated 2 years ago
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆823Updated last year
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆525Updated 2 years ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆952Updated 10 months ago
• showlab / VLog
  [CVPR 2025] Video Narration as Vocabulary & Video as Long Document
  ☆588Updated 10 months ago
• showlab / Image2Paragraph
  [Image 2 Text Para] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
  ☆825Updated 2 years ago
• microsoft / i-Code
  ☆1,708Updated last year
• lupantech / ScienceQA
  Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
  ☆722Updated last year
• OptimalScale / DetGPT
  ☆792Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆356Updated 6 months ago
• ctlllll / LLM-ToolMaker
  ☆1,057Updated 2 years ago
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆364Updated 2 years ago
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆467Updated 2 years ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆485Updated 2 years ago
• cvlab-columbia / viper
  Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
  ☆1,713Updated 2 years ago
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆864Updated 8 months ago
• google-research / pix2struct
  ☆678Updated 8 months ago
• NVlabs / prismer
  The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
  ☆1,312Updated 2 years ago
• microsoft / SoM
  [arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,512Updated last year
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆357Updated 2 years ago
• shikras / shikra
  ☆805Updated last year
• jshilong / GPT4RoI
  (ECCVW 2025)GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆551Updated 8 months ago
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆511Updated 2 years ago
• VITA-MLLM / Woodpecker
  ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
  ☆650Updated last year
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆975Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆823Updated 2 years ago