Alternatives and similar repositories for MM-REACT:

Users that are interested in MM-REACT are comparing it to the libraries listed below

• AILab-CVC / GPT4Tools
  GPT4Tools is an intelligent system that can automatically decide, control, and utilize different visual foundation models, allowing the u…
  ☆764Updated last year
• lupantech / chameleon-llm
  Codes for "Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models".
  ☆1,108Updated last year
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,487Updated last year
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆721Updated 11 months ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆916Updated 7 months ago
• yxuansu / PandaGPT
  [TLLM'23] PandaGPT: One Model To Instruction-Follow Them All
  ☆780Updated last year
• Victorwz / LongMem
  Official implementation of our NeurIPS 2023 paper "Augmenting Language Models with Long-Term Memory".
  ☆777Updated 10 months ago
• ctlllll / LLM-ToolMaker
  ☆1,025Updated last year
• microsoft / SoM
  Set-of-Mark Prompting for GPT-4V and LMMs
  ☆1,258Updated 5 months ago
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆512Updated last year
• agiresearch / OpenAGI
  OpenAGI: When LLM Meets Domain Experts
  ☆2,034Updated 2 months ago
• jshilong / GPT4RoI
  GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆521Updated 7 months ago
• Vision-CAIR / ChatCaptioner
  Official Repository of ChatCaptioner
  ☆460Updated last year
• OptimalScale / DetGPT
  ☆764Updated 5 months ago
• shikras / shikra
  ☆757Updated 6 months ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆478Updated last year
• eric-ai-lab / MiniGPT-5
  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"
  ☆858Updated last month
• showlab / Image2Paragraph
  [A toolbox for fun.] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
  ☆801Updated last year
• OpenGVLab / Multi-Modality-Arena
  Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…
  ☆485Updated 9 months ago
• yuchenlin / LLM-Blender
  [ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the dive…
  ☆903Updated 3 months ago
• microsoft / i-Code
  ☆1,683Updated 4 months ago
• ContextualAI / lens
  This is the official repository for the LENS (Large Language Models Enhanced to See) system.
  ☆351Updated last year
• cvlab-columbia / viper
  Code for the paper "ViperGPT: Visual Inference via Python Execution for Reasoning"
  ☆1,668Updated last year
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆357Updated last year
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆506Updated last year
• arielnlee / Platypus
  Code for fine-tuning Platypus fam LLMs using LoRA
  ☆626Updated 11 months ago
• showlab / VLog
  Transform Video as a Document with ChatGPT, CLIP, BLIP2, GRIT, Whisper, LangChain.
  ☆549Updated last year
• THUDM / AgentBench
  A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)
  ☆2,346Updated 2 months ago
• lucidrains / toolformer-pytorch
  Implementation of Toolformer, Language Models That Can Use Tools, by MetaAI
  ☆1,996Updated 6 months ago
• kyegomez / CM3Leon
  An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal …
  ☆363Updated last year