Alternatives and similar repositories for awesome-vlm-architectures

Users that are interested in awesome-vlm-architectures are comparing it to the libraries listed below

• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
  ☆2,446Updated last week
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆520Updated 2 months ago
• 2U1 / Qwen2-VL-Finetune
  An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.
  ☆784Updated this week
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆825Updated last month
• beichenzbc / Long-CLIP
  [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"
  ☆813Updated 9 months ago
• EvolvingLMMs-Lab / open-r1-multimodal
  A fork to add multimodal model training to open-r1
  ☆1,281Updated 3 months ago
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆1,066Updated 3 months ago
• showlab / Awesome-MLLM-Hallucination
  📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).
  ☆709Updated last month
• Computer-Vision-in-the-Wild / CVinW_Readings
  A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''
  ☆1,299Updated last year
• facebookresearch / perception_models
  State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
  ☆1,189Updated last week
• DirtyHarryLYL / LLM-in-Vision
  Recent LLM-based CV and related works. Welcome to comment/contribute!
  ☆865Updated 2 months ago
• mbzuai-oryx / groundingLMM
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…
  ☆883Updated 6 months ago
• jingyi0000 / VLM_survey
  Collection of AWESOME vision-language models for vision tasks
  ☆2,751Updated last week
• LLaVA-VL / LLaVA-NeXT
  ☆3,873Updated last week
• JindongGu / Awesome-Prompting-on-Vision-Language-Model
  This repo lists relevant papers summarized in our survey paper: A Systematic Survey of Prompt Engineering on Vision-Language Foundation …
  ☆466Updated 2 months ago
• yaotingwangofficial / Awesome-MCoT
  Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey
  ☆613Updated 2 weeks ago
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆923Updated 2 months ago
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆557Updated last month
• uncbiag / Awesome-Foundation-Models
  A curated list of foundation models for vision and language tasks
  ☆1,017Updated 3 weeks ago
• NVlabs / RADIO
  Official repository for "AM-RADIO: Reduce All Domains Into One"
  ☆1,179Updated this week
• lucidrains / transfusion-pytorch
  Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
  ☆1,133Updated 3 weeks ago
• TRI-ML / prismatic-vlms
  A flexible and efficient codebase for training visually-conditioned language models (VLMs)
  ☆693Updated 11 months ago
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆2,135Updated 2 months ago
• friedrichor / Awesome-Multimodal-Papers
  A curated list of awesome Multimodal studies.
  ☆197Updated last week
• allenai / molmo
  Code for the Molmo Vision-Language Model
  ☆431Updated 5 months ago
• awaisrauf / Awesome-CV-Foundational-Models
  ☆517Updated 6 months ago
• zhangfaen / finetune-Qwen2-VL
  ☆362Updated 3 months ago
• yunlong10 / Awesome-LLMs-for-Video-Understanding
  🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.
  ☆2,356Updated this week
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆1,017Updated 6 months ago
• penghao-wu / vstar
  PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"
  ☆619Updated last year