Jielin-Qiu / MM_Robustness
[DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
☆32Updated 7 months ago
Related projects: ⓘ
- Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022☆29Updated last year
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆31Updated last year
- Code for Debiasing Vision-Language Models via Biased Prompts☆50Updated last year
- Official implementation of our EMNLP 2022 paper "CPL: Counterfactual Prompt Learning for Vision and Language Models"☆32Updated last year
- Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"☆29Updated 6 months ago
- Official implementation for NeurIPS'23 paper "Geodesic Multi-Modal Mixup for Robust Fine-Tuning"☆27Updated 8 months ago
- Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight☆32Updated last year
- Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".☆32Updated 6 months ago
- Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.☆32Updated last year
- ☆25Updated 7 months ago
- [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?☆31Updated last year
- ☆24Updated last year
- The Continual Learning in Multimodality Benchmark☆58Updated last year
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆32Updated last year
- This repo contains codes and instructions for baselines in the VLUE benchmark.☆41Updated 2 years ago
- [Arxiv] Calibrated Self-Rewarding Vision Language Models☆35Updated 3 months ago
- ☆20Updated 3 months ago
- NegCLIP.☆23Updated last year
- The SVO-Probes Dataset for Verb Understanding☆29Updated 2 years ago
- This repo is the official implementation of UPL (Unsupervised Prompt Learning for Vision-Language Models).☆103Updated 2 years ago
- LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images☆27Updated 9 months ago
- Official repository for the ICCV 2023 paper: "Waffling around for Performance: Visual Classification with Random Words and Broad Concepts…☆51Updated last year
- Counterfactual Reasoning VQA Dataset☆24Updated 9 months ago
- This repo implements the CVPR23 paper Trainable Projected Gradient Method for Robust Fine-tuning☆21Updated 9 months ago
- ☆55Updated last year
- ☆18Updated 2 years ago
- Repository for the paper: Teaching Structured Vision & Language Concepts to Vision & Language Models☆44Updated 11 months ago
- Repo for ICCV 2021 paper: Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering☆24Updated 2 months ago
- code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720☆52Updated 3 months ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆61Updated 4 months ago