Alternatives and similar repositories for awesome-vlm-architectures

Users that are interested in awesome-vlm-architectures are comparing it to the libraries listed below

• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
  ☆2,358Updated this week
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆817Updated 2 weeks ago
• beichenzbc / Long-CLIP
  [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"
  ☆807Updated 9 months ago
• DirtyHarryLYL / LLM-in-Vision
  Recent LLM-based CV and related works. Welcome to comment/contribute!
  ☆862Updated 2 months ago
• mbzuai-oryx / groundingLMM
  [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…
  ☆877Updated 5 months ago
• 2U1 / Qwen2-VL-Finetune
  An open-source implementaion for fine-tuning Qwen2-VL and Qwen2.5-VL series by Alibaba Cloud.
  ☆719Updated 2 weeks ago
• showlab / Awesome-Unified-Multimodal-Models
  📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.
  ☆542Updated last month
• showlab / Awesome-MLLM-Hallucination
  📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).
  ☆681Updated last month
• facebookresearch / perception_models
  State-of-the-art Image & Video CLIP, Multimodal Large Language Models, and More!
  ☆1,071Updated last week
• friedrichor / Awesome-Multimodal-Papers
  A curated list of awesome Multimodal studies.
  ☆192Updated this week
• JindongGu / Awesome-Prompting-on-Vision-Language-Model
  This repo lists relevant papers summarized in our survey paper: A Systematic Survey of Prompt Engineering on Vision-Language Foundation …
  ☆457Updated last month
• uncbiag / Awesome-Foundation-Models
  A curated list of foundation models for vision and language tasks
  ☆998Updated 2 weeks ago
• LLaVA-VL / LLaVA-NeXT
  ☆3,818Updated last week
• microsoft / LLM2CLIP
  LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.
  ☆513Updated last month
• jingyi0000 / VLM_survey
  Collection of AWESOME vision-language models for vision tasks
  ☆2,720Updated this week
• EvolvingLMMs-Lab / open-r1-multimodal
  A fork to add multimodal model training to open-r1
  ☆1,255Updated 3 months ago
• OpenGVLab / VisionLLM
  VisionLLM Series
  ☆1,059Updated 2 months ago
• Yangyi-Chen / Multimodal-AND-Large-Language-Models
  Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.
  ☆621Updated this week
• zhangfaen / finetune-Qwen2-VL
  ☆359Updated 3 months ago
• TRI-ML / prismatic-vlms
  A flexible and efficient codebase for training visually-conditioned language models (VLMs)
  ☆675Updated 10 months ago
• awaisrauf / Awesome-CV-Foundational-Models
  ☆515Updated 6 months ago
• DAMO-NLP-SG / VideoLLaMA2
  VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
  ☆1,159Updated 3 months ago
• baaivision / Emu3
  Next-Token Prediction is All You Need
  ☆2,121Updated last month
• Computer-Vision-in-the-Wild / CVinW_Readings
  A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''
  ☆1,288Updated last year
• zjysteven / lmms-finetune
  A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…
  ☆294Updated 2 months ago
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆392Updated 3 months ago
• YingqingHe / Awesome-LLMs-meet-Multimodal-Generation
  🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).
  ☆473Updated last month
• allenai / molmo
  Code for the Molmo Vision-Language Model
  ☆413Updated 5 months ago
• yunlong10 / Awesome-LLMs-for-Video-Understanding
  🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.
  ☆2,275Updated last week
• ModalMinds / MM-EUREKA
  MM-EUREKA: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning
  ☆597Updated last week