Alternatives and similar repositories for MM-REACT

Users that are interested in MM-REACT are comparing it to the libraries listed below

• AILab-CVC / GPT4Tools
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…
  ☆773Updated last year
• lupantech / chameleon-llm
  Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
  ☆1,139Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆762Updated last year
• yxuansu / PandaGPT
  [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All
  ☆833Updated 2 years ago
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,515Updated 2 years ago
• showlab / VLog
  [CVPR 2025] Video Narration as Vocabulary & Video as Long Document
  ☆582Updated 8 months ago
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆523Updated last year
• OptimalScale / DetGPT
  ☆788Updated last year
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆817Updated last year
• microsoft / SoM
  [arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,487Updated last year
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆467Updated 2 years ago
• lupantech / ScienceQA
  Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
  ☆707Updated last year
• showlab / Image2Paragraph
  [Image 2 Text Para] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
  ☆822Updated 2 years ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆946Updated 8 months ago
• ctlllll / LLM-ToolMaker
  ☆1,050Updated 2 years ago
• microsoft / i-Code
  ☆1,709Updated last year
• cvlab-columbia / viper
  Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
  ☆1,710Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆357Updated 4 months ago
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆510Updated 2 years ago
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆363Updated last year
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆863Updated 6 months ago
• IBM / Dromedary
  Dromedary: towards helpful, ethical and reliable LLMs.
  ☆1,144Updated 2 months ago
• NVlabs / prismer
  The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
  ☆1,307Updated last year
• shikras / shikra
  ☆798Updated last year
• google-research / pix2struct
  ☆669Updated 6 months ago
• jshilong / GPT4RoI
  GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆549Updated 6 months ago
• booydar / recurrent-memory-transformer
  [NeurIPS 22] [AAAI 24] Recurrent Transformer-based long-context architecture.
  ☆775Updated last year
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆823Updated 2 years ago
• VITA-MLLM / Woodpecker
  ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
  ☆641Updated 11 months ago
• OpenLemur / Lemur
  [ICLR 2024] Lemur: Open Foundation Models for Language Agents
  ☆555Updated 2 years ago