Alternatives and similar repositories for MM-REACT

Users that are interested in MM-REACT are comparing it to the libraries listed below

• AILab-CVC / GPT4Tools
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…
  ☆772Updated last year
• lupantech / chameleon-llm
  Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
  ☆1,138Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆760Updated last year
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,512Updated 2 years ago
• OptimalScale / DetGPT
  ☆787Updated last year
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆942Updated 7 months ago
• yxuansu / PandaGPT
  [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All
  ☆831Updated 2 years ago
• lupantech / ScienceQA
  Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
  ☆699Updated last year
• microsoft / i-Code
  ☆1,705Updated last year
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆522Updated last year
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆816Updated last year
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆862Updated 6 months ago
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆466Updated 2 years ago
• showlab / VLog
  [CVPR 2025] Video Narration as Vocabulary & Video as Long Document
  ☆579Updated 8 months ago
• showlab / Image2Paragraph
  [Image 2 Text Para] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
  ☆820Updated 2 years ago
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆354Updated 3 months ago
• VITA-MLLM / Woodpecker
  ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
  ☆638Updated 10 months ago
• ctlllll / LLM-ToolMaker
  ☆1,044Updated 2 years ago
• NVlabs / prismer
  The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
  ☆1,304Updated last year
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆510Updated 2 years ago
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆361Updated last year
• cvlab-columbia / viper
  Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
  ☆1,708Updated last year
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,754Updated last year
• shikras / shikra
  ☆797Updated last year
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆483Updated 2 years ago
• IBM / Dromedary
  Dromedary: towards helpful, ethical and reliable LLMs.
  ☆1,144Updated last month
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆970Updated last year
• jshilong / GPT4RoI
  GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆548Updated 5 months ago
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆821Updated 2 years ago
• microsoft / SoM
  [arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,476Updated last year