Alternatives and similar repositories for SoM:

Users that are interested in SoM are comparing it to the libraries listed below

• ddupont808 / GPT-4V-Act
  AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI
  ☆1,036Updated 4 months ago
• LLaVA-VL / LLaVA-Plus-Codebase
  LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills
  ☆739Updated last year
• dvlab-research / LLaMA-VID
  LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)
  ☆805Updated 9 months ago
• mbzuai-oryx / groundingLMM
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…
  ☆867Updated 5 months ago
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆1,054Updated 2 months ago
• OSU-NLP-Group / SeeAct
  [ICML'24] SeeAct is a system for generalist web agents that autonomously carry out tasks on any given website, with a focus on large mult…
  ☆742Updated 3 months ago
• PKU-YuanGroup / Video-LLaVA
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
  ☆3,238Updated 5 months ago
• IDEA-Research / Grounding-DINO-1.5-API
  Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series
  ☆941Updated 3 months ago
• microsoft / MM-REACT
  Official repo for MM-REACT
  ☆949Updated last year
• OSU-NLP-Group / Mind2Web
  [NeurIPS'23 Spotlight] "Mind2Web: Towards a Generalist Agent for the Web"
  ☆819Updated last month
• UX-Decoder / Semantic-SAM
  [ECCV 2024] Official implementation of the paper "Semantic-SAM: Segment and Recognize Anything at Any Granularity"
  ☆2,604Updated 9 months ago
• shikras / shikra
  ☆778Updated 9 months ago
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆602Updated last year
• LLaVA-VL / LLaVA-Interactive-Demo
  LLaVA-Interactive-Demo
  ☆369Updated 9 months ago
• web-arena-x / webarena
  Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
  ☆981Updated 3 months ago
• baaivision / Emu
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,716Updated 7 months ago
• showlab / Image2Paragraph
  [Image 2 Text Para] Transform Image into Unique Paragraph with ChatGPT, BLIP2, OFA, GRIT, Segment Anything, ControlNet.
  ☆807Updated 2 years ago
• dvlab-research / LISA
  Project Page for "LISA: Reasoning Segmentation via Large Language Model"
  ☆2,185Updated 2 months ago
• facebookresearch / MetaCLIP
  ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expert…
  ☆1,428Updated last month
• remyxai / VQASynth
  Compose multimodal datasets 🎹
  ☆360Updated 2 weeks ago
• mbzuai-oryx / Video-ChatGPT
  [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the cap…
  ☆1,352Updated last month
• Meituan-AutoML / MobileVLM
  Strong and Open Vision Language Assistant for Mobile Devices
  ☆1,206Updated last year
• magic-research / bubogpt
  BuboGPT: Enabling Visual Grounding in Multi-Modal LLMs
  ☆508Updated last year
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆2,153Updated 5 months ago
• ttengwang / Caption-Anything
  Caption-Anything is a versatile tool combining image segmentation, visual captioning, and ChatGPT, generating tailored captions with dive…
  ☆1,738Updated last year
• DirtyHarryLYL / LLM-in-Vision
  Recent LLM-based CV and related works. Welcome to comment/contribute!
  ☆861Updated last month
• OptimalScale / DetGPT
  ☆773Updated 9 months ago
• Alpha-VLLM / LLaMA2-Accessory
  An Open-source Toolkit for LLM Development
  ☆2,776Updated 3 months ago
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆1,015Updated 5 months ago
• IDEA-Research / Grounded-SAM-2
  Grounded SAM 2: Ground and Track Anything in Videos with Grounding DINO, Florence-2 and SAM 2
  ☆2,072Updated 2 weeks ago