Alternatives and similar repositories for CRIPP-VQA:

Users that are interested in CRIPP-VQA are comparing it to the libraries listed below

• Jielin-Qiu / MM_Robustness
  [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  ☆34Updated last year
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆33Updated last year
• showlab / CLVQA
  [AAAI2023] Symbolic Replay: Scene Graph as Prompt for Continual Learning on VQA Task (Oral)
  ☆39Updated 10 months ago
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• UMass-Foundation-Model / genome
  ☆15Updated last year
• limanling / KnowledgeVL-Reading
  ☆67Updated last year
• zfchenUnique / compositional_physics_learner
  ☆38Updated 2 years ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• wllmzhu / G-VUE
  General-purpose Visual Understanding Evaluation
  ☆20Updated last year
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆24Updated last year
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆26Updated last year
• gistvision / moca
  Code and models of MOCA (Modular Object-Centric Approach) proposed in "Factorizing Perception and Policy for Interactive Instruction Foll…
  ☆37Updated 7 months ago
• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 3 years ago
• Lizw14 / CaliCO
  Code for ICCV2021 paper: Calibrating Concepts and Operations: Towards Symbolic Reasoning on Real Images
  ☆13Updated 2 years ago
• gqa-ood / GQA-OOD
  GQA-OOD is a new dataset and benchmark for the evaluation of VQA models in OOD (out of distribution) settings.
  ☆28Updated 3 years ago
• evelinehong / PTR
  Official Repository of NeurIPS2021 paper: PTR
  ☆33Updated 3 years ago
• microsoft / DFOL-VQA
  Differentiable First-Order Logic Reasoning for Visual Question Answering
  ☆39Updated 3 years ago
• McGill-NLP / diffusion-itm
  Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"
  ☆31Updated 11 months ago
• RAIVNLab / CREPE
  [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?
  ☆32Updated last year
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆27Updated 3 months ago
• zfchenUnique / DCL-Release
  This repo contains the pytorch implementation for Dynamic Concept Learner (accepted by ICLR 2021).
  ☆37Updated 7 months ago
• dingmyu / VRDP
  [NeurIPS 2021] Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language
  ☆45Updated last year
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆15Updated 9 months ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆112Updated last year
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆29Updated last year
• CVMI-Lab / clip-beyond-tail
  (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights
  ☆24Updated 3 months ago
• NVlabs / RelViT
  [ICLR 2022] RelViT: Concept-guided Vision Transformer for Visual Relational Reasoning
  ☆64Updated 2 years ago
• LisaAnne / Hallucination
  ☆64Updated 5 years ago
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆31Updated last year
• szzexpoi / rex
  Official Repository for CVPR 2022 paper "REX: Reasoning-aware and Grounded Explanation"
  ☆21Updated last year