Alternatives and similar repositories for Vision-language-models-VLM:

Users that are interested in Vision-language-models-VLM are comparing it to the libraries listed below

• ECOFRI / CXR_LLaVA
  ☆40Updated 10 months ago
• m1k2zoo / negbench
  Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"
  ☆20Updated last week
• ashishpatel26 / ai-tutor-rag-system
  This is a repository for the course "From Beginner to LLM Developer" by Towards AI.
  ☆11Updated 3 months ago
• lucidrains / vit-arc-slot
  Explorations into improving ViTArc with Slot Attention
  ☆39Updated 5 months ago
• Agora-Lab-AI / OmegaViT
  OmegaViT (ΩViT) is a cutting-edge vision transformer architecture that combines multi-query attention, rotary embeddings, state space mod…
  ☆14Updated last week
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆71Updated 3 weeks ago
• Weixin-Liang / Mixture-of-Mamba
  ☆40Updated 2 months ago
• MontrealAI / AGI-Agent-v0
  A minimal yet unstoppable blueprint for multi-agent AI—anchored by the rare, far-reaching “Multi-Agent AI DAO” (2017 Prior Art)—empowerin…
  ☆23Updated 3 months ago
• iancovert / locality-alignment
  ☆45Updated 3 months ago
• ZhilingYan / GPT4V-Medical-Report
  ☆43Updated 6 months ago
• XiaoduoAILab / XmodelVLM
  ☆68Updated 9 months ago
• GaiZhenbiao / Phi3V-Finetuning
  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.
  ☆58Updated 10 months ago
• alexander-moore / vlm
  Composition of Multimodal Language Models From Scratch
  ☆14Updated 8 months ago
• samar-khanna / ExPLoRA
  Official code repository for paper: "ExPLoRA: Parameter-Efficient Extended Pre-training to Adapt Vision Transformers under Domain Shifts"
  ☆31Updated 6 months ago
• ariG23498 / fine-tune-paligemma
  Notebooks for fine tuning pali gemma
  ☆100Updated this week
• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 2 months ago
• sitloboi2012 / Visualization-of-Thought
  The implementation of the paper: "Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models"
  ☆29Updated last year
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆58Updated last month
• abachaa / MEDEC
  ☆34Updated 3 months ago
• KindXiaoming / physics_of_skill_learning
  We study toy models of skill learning.
  ☆25Updated 2 months ago
• metal-chart-generation / metal
  ☆23Updated 3 weeks ago
• kyegomez / TinyGPTV
  Simple Implementation of TinyGPTV in super simple Zeta lego blocks
  ☆16Updated 5 months ago
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆21Updated 2 weeks ago
• roboflow / model-leaderboard
  Which model is the best at object detection? Which is best for small or large objects? We compare the results in a handy leaderboard.
  ☆68Updated this week
• haotian-liu / transformers_llava
  ☆13Updated last year
• top-yun / MS-PR
  Multi-vision Sensor Perception and Reasoning (MS-PR) benchmark, assessing VLMs on their capacity for sensor-specific reasoning.
  ☆14Updated last month
• autodistill / autodistill-grounded-edgesam
  EdgeSAM model for use with Autodistill.
  ☆26Updated 10 months ago
• google-research / silc
  [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation
  ☆42Updated 6 months ago
• kyegomez / SimpleMamba
  Implementation of a modular, high-performance, and simplistic mamba for high-speed applications
  ☆34Updated 5 months ago
• qnguyen3 / nanoLLaVA
  World's Smallest Vision-Language Model
  ☆26Updated last year