Alternatives and similar repositories for MM-REACT:

Users that are interested in MM-REACT are comparing it to the libraries listed below

• AILab-CVC / GPT4Tools
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…
  ☆770Updated last year
• lupantech / chameleon-llm
  Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
  ☆1,126Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆737Updated last year
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,497Updated last year
• yxuansu / PandaGPT
  [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All
  ☆783Updated last year
• showlab / VLog
  [CVPR 2025] Video Narration as Vocabulary & Video as Long Document
  ☆567Updated last month
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆789Updated last year
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆520Updated last year
• microsoft / SoM
  Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,353Updated 7 months ago
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆931Updated 5 months ago
• lupantech / ScienceQA
  Data and code for NeurIPS 2022 Paper "Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering".
  ☆652Updated 6 months ago
• OptimalScale / DetGPT
  ☆770Updated 8 months ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆925Updated 3 weeks ago
• ctlllll / LLM-ToolMaker
  ☆1,029Updated last year
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆357Updated last year
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆464Updated 2 years ago
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆508Updated last year
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆352Updated last year
• lyuchenyang / Macaw-LLM
  Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration
  ☆1,561Updated 3 months ago
• mbzuai-nlp / LaMini-LM
  LaMini-LM: A Diverse Herd of Distilled Models from Large-Scale Instructions
  ☆821Updated last year
• showlab / Image2Paragraph
  [A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
  ☆806Updated last year
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,768Updated 3 months ago
• jshilong / GPT4RoI
  GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆525Updated 10 months ago
• NVlabs / prismer
  The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".
  ☆1,310Updated last year
• mlfoundations / datacomp
  DataComp: In search of the next generation of multimodal datasets
  ☆695Updated last year
• microsoft / i-Code
  ☆1,697Updated 6 months ago
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆863Updated 4 months ago
• booydar / recurrent-memory-transformer
  [NeurIPS 22] [AAAI 24] Recurrent Transformer-based long-context architecture.
  ☆760Updated 5 months ago
• OpenGVLab / Ask-Anything
  [CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
  ☆3,213Updated 2 months ago
• CStanKonrad / long_llama
  LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA and fine-tuned with the Focused Transform…
  ☆1,452Updated last year