Alternatives and similar repositories for ALM-Bench

Users that are interested in ALM-Bench are comparing it to the libraries listed below

• mbzuai-oryx / PALO
  (WACV 2025 - Oral) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, H…
  ☆84Updated 4 months ago
• pliang279 / HEMM
  Holistic evaluation of multimodal foundation models
  ☆48Updated 10 months ago
• m1k2zoo / negbench
  Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"
  ☆24Updated 2 months ago
• AtsuMiyai / UPD
  [ACL2025] Unsolvable Problem Detection: Robust Understanding Evaluation for Large Multimodal Models
  ☆77Updated 3 weeks ago
• google-research / silc
  [ECCV 2024] Official Release of SILC: Improving vision language pretraining with self-distillation
  ☆44Updated 8 months ago
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated 10 months ago
• eric-ai-lab / ComCLIP
  Official implementation and dataset for the NAACL 2024 paper "ComCLIP: Training-Free Compositional Image and Text Matching"
  ☆35Updated 10 months ago
• apple / ml-rpm-bench
  ☆41Updated 11 months ago
• Nusrat-Prottasha / PEFT-A2Z
  ☆24Updated 2 months ago
• XMUDeepLIT / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆28Updated 8 months ago
• ExplainableML / sae-for-vlm
  Sparse Autoencoders Learn Monosemantic Features in Vision-Language Models
  ☆19Updated 2 months ago
• nickjiang2378 / vl-interp
  Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)
  ☆75Updated last month
• mbzuai-oryx / VideoMolmo
  Official code of the paper "VideoMolmo: Spatio-Temporal Grounding meets Pointing"
  ☆42Updated last week
• HashmatShadab / MambaRobustness
  [CVPRW 2025] Official repository of paper titled "Towards Evaluating the Robustness of Visual State Space Models"
  ☆24Updated 2 weeks ago
• kyegomez / MC-ViT
  Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"
  ☆20Updated 2 months ago
• iancovert / locality-alignment
  ☆50Updated 5 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆137Updated 5 months ago
• orrzohar / Video-STaR
  [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆64Updated 11 months ago
• alhojel / visual_task_vectors
  ☆37Updated 11 months ago
• k1rezaei / Text-to-concept
  ☆33Updated last year
• htqin / GoogleBard-VisUnderstand
  How Good is Google Bard's Visual Understanding? An Empirical Study on Open Challenges
  ☆30Updated last year
• Hao840 / ADEM-VL
  PyTorch code for "ADEM-VL: Adaptive and Embedded Fusion for Efficient Vision-Language Tuning"
  ☆20Updated 8 months ago
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆57Updated 2 months ago
• yuhui-zh15 / AutoConverter
  Official implementation of "Automated Generation of Challenging Multiple-Choice Questions for Vision Language Model Evaluation" (CVPR 202…
  ☆30Updated last month
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆119Updated last year
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆15Updated 7 months ago
• jmhb0 / microvqa
  [CVPR 2025] MicroVQA eval and 🤖RefineBot code for "MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research"…
  ☆21Updated 3 months ago
• facebookresearch / Mixture-of-Transformers
  Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models. TMLR 2025.
  ☆78Updated last month
• locuslab / llava-token-compression
  ☆42Updated 7 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆27Updated last month