Alternatives and similar repositories for ALM-Bench

Users that are interested in ALM-Bench are comparing it to the libraries listed below

• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆83Updated 3 months ago
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆47Updated last year
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆78Updated 5 months ago
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆163Updated last month
• jmhb0 / viddiff
  [ICLR 2025] Video Action Differencing
  ☆48Updated 4 months ago
• google-research / silc
  [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation
  ☆47Updated last year
• iancovert / locality-alignment
  ☆53Updated 10 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆115Updated 9 months ago
• nickjiang2378 / vlm-hallucinations
  [ICLR '25] Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆92Updated 5 months ago
• ilkerkesen / ViLMA
  ViLMA: A Zero-Shot Benchmark for Linguistic and Temporal Grounding in Video-Language Models (ICLR 2024, Official Implementation)
  ☆16Updated last year
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆219Updated 3 weeks ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆88Updated last year
• apple / ml-rpm-bench
  ☆41Updated last year
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆149Updated last month
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024
  ☆108Updated last year
• Ravindu-Yasas-Nagasinghe / KEPP
  [CVPR 2024] KEPP: Why Not Use Your Textbook? Knowledge-Enhanced Procedure Planning of Instructional Videos
  ☆12Updated last year
• k1rezaei / Text-to-concept
  ☆35Updated last year
• mominabbass / LinC
  Code for "Enhancing In-context Learning via Linear Probe Calibration"
  ☆36Updated last year
• m1k2zoo / negbench
  Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"
  ☆38Updated 6 months ago
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆127Updated 2 weeks ago
• XMUDeepLIT / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆33Updated last year
• togethercomputer / Dragonfly
  ☆80Updated last year
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆39Updated 5 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆48Updated last year
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆94Updated 3 weeks ago
• amazon-science / QA-ViT
  ☆69Updated last year
• Hon-Wong / VoRA
  [Fully open] [Encoder-free MLLM] Vision as LoRA
  ☆346Updated 5 months ago
• aimagelab / LLaVA-MORE
  [ICCVW 25] LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning
  ☆155Updated 3 months ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• wjpoom / SPEC
  [CVPR 2024] The official implementation of paper "synthesize, diagnose, and optimize: towards fine-grained vision-language understanding"
  ☆49Updated 5 months ago