Alternatives and similar repositories for vision-llms-are-blind:

Users that are interested in vision-llms-are-blind are comparing it to the libraries listed below

• apple / ml-rpm-bench
  ☆39Updated 5 months ago
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆181Updated 3 weeks ago
• ByungKwanLee / Phantom
  [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…
  ☆49Updated 3 months ago
• prometheus-eval / prometheus-vision
  [ACL 2024 Findings & ICLR 2024 WS] An Evaluator VLM that is open-source, offers reproducible evaluation, and inexpensive to use. Specific…
  ☆62Updated 4 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆90Updated last month
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆72Updated 4 months ago
• togethercomputer / Dragonfly
  ☆73Updated 3 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆98Updated 2 weeks ago
• chenllliang / DnD-Transformer
  Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …
  ☆62Updated last month
• EternityYW / Gemini-Commonsense-Evaluation
  Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"
  ☆35Updated last year
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆71Updated 5 months ago
• neulab / MultiUI
  Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding
  ☆44Updated last month
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆169Updated 3 weeks ago
• ByungKwanLee / TroL
  [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…
  ☆90Updated 6 months ago
• UCSC-VLAA / Recap-DataComp-1B
  This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"
  ☆126Updated 7 months ago
• Adamdad / neumeta
  NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…
  ☆39Updated 2 months ago
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models".
  ☆99Updated 7 months ago
• Yushi-Hu / VisualSketchpad
  Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models
  ☆153Updated 2 months ago
• mbzuai-oryx / PALO
  (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, B…
  ☆81Updated 4 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆145Updated 2 weeks ago
• vis-nlp / ChartGemma
  ☆57Updated 6 months ago
• XiaoduoAILab / XmodelVLM
  ☆65Updated 6 months ago
• mistralai / mistral-evals
  ☆56Updated 3 months ago
• CERC-AAI / Robin
  ☆62Updated 3 months ago
• mbzuai-oryx / LlamaV-o1
  Rethinking Step-by-step Visual Reasoning in LLMs
  ☆174Updated this week
• google-research / silc
  [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation
  ☆40Updated 3 months ago
• bethgelab / frequency_determines_performance
  Code for the paper: "No Zero-Shot Without Exponential Data: Pretraining Concept Frequency Determines Multimodal Model Performance" [NeurI…
  ☆80Updated 8 months ago
• RobertCsordas / moeut
  ☆69Updated 5 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆50Updated 4 months ago
• gstoica27 / KnOTS
  ☆40Updated last month