Alternatives and similar repositories for vision-llms-are-blind

Users that are interested in vision-llms-are-blind are comparing it to the libraries listed below

• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆69Updated 8 months ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆58Updated 7 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆106Updated 3 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆77Updated this week
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆80Updated 2 months ago
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆96Updated 10 months ago
• apple / ml-rpm-bench
  ☆41Updated 9 months ago
• UCSC-VLAA / Recap-DataComp-1B
  [ICML 2025] This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆130Updated 11 months ago
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".
  ☆102Updated 11 months ago
• JieyuZ2 / TaskMeAnything
  [NeurIPS 2024] A task generation and model evaluation system for multimodal language models.
  ☆70Updated 5 months ago
• yihedeng9 / OpenVLThinker
  OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement
  ☆84Updated last week
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆205Updated this week
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆129Updated 3 months ago
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆36Updated last year
• vis-nlp / ChartGemma
  ☆61Updated 10 months ago
• jonathan-roberts1 / zerobench
  Code, Data and Red Teaming for ZeroBench
  ☆46Updated 2 weeks ago
• naver-ai / model-stock
  Model Stock: All we need is just a few fine-tuned models
  ☆114Updated 7 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆62Updated 10 months ago
• bethgelab / frequency_determines_performance
  Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurI…
  ☆90Updated last year
• facebookresearch / webssl
  Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).
  ☆122Updated 2 weeks ago
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆140Updated this week
• shulin16 / MMInA
  Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"
  ☆43Updated 2 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆66Updated 11 months ago
• IntelLabs / multimodal_cognitive_ai
  research work on multimodal cognitive ai
  ☆60Updated last week
• XiaoduoAILab / XmodelVLM
  ☆68Updated 10 months ago
• declare-lab / LLM-PuzzleTest
  This repository is maintained to release dataset and models for multimodal puzzle reasoning.
  ☆86Updated 2 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆83Updated last year
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆176Updated 2 weeks ago
• si0wang / ThinkLite-VL
  ☆76Updated last week
• togethercomputer / Dragonfly
  ☆75Updated 7 months ago