Alternatives and similar repositories for MM-REACT

Users that are interested in MM-REACT are comparing it to the libraries listed below

• AILab-CVC / GPT4Tools
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…
  ☆773Updated last year
• lupantech / chameleon-llm
  Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
  ☆1,134Updated last year
• yxuansu / PandaGPT
  [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All
  ☆821Updated 2 years ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆759Updated last year
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,508Updated 2 years ago
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆808Updated last year
• lupantech / ScienceQA
  Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
  ☆691Updated last year
• ctlllll / LLM-ToolMaker
  ☆1,042Updated 2 years ago
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆524Updated last year
• microsoft / i-Code
  ☆1,710Updated last year
• OptimalScale / DetGPT
  ☆787Updated last year
• showlab / VLog
  [CVPR 2025] Video Narration as Vocabulary & Video as Long Document
  ☆578Updated 6 months ago
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆354Updated 2 months ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆941Updated 6 months ago
• NVlabs / prismer
  The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
  ☆1,309Updated last year
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆860Updated 4 months ago
• VITA-MLLM / Woodpecker
  ✨✨Woodpecker: Hallucination Correction for Multimodal Large Language Models
  ☆639Updated 9 months ago
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆466Updated 2 years ago
• google-research / pix2struct
  ☆658Updated 4 months ago
• cvlab-columbia / viper
  Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
  ☆1,707Updated last year
• microsoft / SoM
  [arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,463Updated last year
• billxbf / ReWOO
  Decoupling Reasoning from Observations for Efficient Augmented Language Models
  ☆920Updated 2 years ago
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆821Updated 2 years ago
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆628Updated last year
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆362Updated last year
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆965Updated 11 months ago
• IBM / Dromedary
  Dromedary: towards helpful, ethical and reliable LLMs.
  ☆1,146Updated 2 weeks ago
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆510Updated 2 years ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆482Updated last year
• OpenLemur / Lemur
  [ICLR 2024] Lemur: Open Foundation Models for Language Agents
  ☆556Updated last year