Alternatives and similar repositories for whatsup_vlms:

Users that are interested in whatsup_vlms are comparing it to the libraries listed below

• yuhui-zh15 / C3
  Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)
  ☆27Updated 3 months ago
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• IntelLabs / lvlm-interpret
  ☆55Updated 6 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆60Updated 7 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆78Updated 8 months ago
• UMass-Foundation-Model / CoVLM
  Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆43Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆29Updated last year
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆74Updated 11 months ago
• bcdnlp / FAITHSCORE
  ☆28Updated 2 months ago
• nickjiang2378 / vl-interp
  Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆51Updated 3 weeks ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆30Updated this week
• rabiulcste / vqazero
  visual question answering prompting recipes for large vision-language models
  ☆23Updated 4 months ago
• RAIVNLab / CREPE
  [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?
  ☆32Updated last year
• ys-zong / VL-ICL
  Code for paper: VL-ICL Bench: The Devil in the Details of Benchmarking Multimodal In-Context Learning
  ☆34Updated last week
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆32Updated last year
• Jielin-Qiu / MM_Robustness
  [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift
  ☆34Updated 11 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆43Updated 6 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆24Updated last year
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆62Updated 7 months ago
• yonatanbitton / wysiwyr
  ☆34Updated last year
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆66Updated 2 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• jmerullo / limber
  https://arxiv.org/abs/2209.15162
  ☆48Updated last year
• McGill-NLP / diffusion-itm
  Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"
  ☆31Updated 10 months ago
• yale-nlp / TOMATO
  ☆19Updated 2 months ago
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆13Updated 8 months ago
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated last month
• lscpku / VITATECS
  ☆17Updated 6 months ago