amitakamath / vl_text_encoders_are_bottlenecks

Related projects ⓘ

Alternatives and complementary repositories for vl_text_encoders_are_bottlenecks

• RAIVNLab / CREPE
  [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?
  ☆32Updated last year
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆22Updated 5 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆34Updated 8 months ago
• dmoltisanti / air-cvpr23
  This repository contains the Adverbs in Recipes (AIR) dataset and the code published at the CVPR 23 paper: "Learning Action Changes by Me…
  ☆13Updated last year
• TAU-VAILab / hierarcaps
  ☆21Updated 2 months ago
• postech-ami / BEAF
  [ECCV’24] Official repository for "BEAF: Observing Before-AFter Changes to Evaluate Hallucination in Vision-language Models"
  ☆18Updated 3 weeks ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆35Updated last year
• ytaek-oh / vl_compo
  ☆11Updated 4 months ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆25Updated 11 months ago
• showlab / datacentric.vlp
  Compress conventional Vision-Language Pre-training data
  ☆49Updated last year
• aszala / VPEval
  VPEval Codebase from Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆43Updated 11 months ago
• princetonvisualai / pointingqa
  Code for paper "Point and Ask: Incorporating Pointing into Visual Question Answering"
  ☆18Updated 2 years ago
• McGill-NLP / diffusion-itm
  Code and data setup for the paper "Are Diffusion Models Vision-and-language Reasoners?"
  ☆31Updated 7 months ago
• mshukor / eP-ALM
  [ICCV23] Official implementation of eP-ALM: Efficient Perceptual Augmentation of Language Models.
  ☆27Updated last year
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆32Updated last year
• NVlabs / PALAVRA
  ☆50Updated 2 years ago
• yonatanbitton / wysiwyr
  ☆31Updated last year
• ExplainableML / ImageSelect
  Code for the paper "If at First You Don't Succeed, Try, Try Again: Faithful Diffusion-based Text-to-Image Generation by Selection"
  ☆27Updated last year
• naver-ai / prolip
  ☆15Updated this week
• codezakh / LilT
  [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning
  ☆36Updated last year
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆26Updated last year
• showlab / MovieSeq
  [ECCV2024] Learning Video Context as Interleaved Multimodal Sequences
  ☆29Updated last month
• j-min / VPGen
  Visual Programming for Text-to-Image Generation and Evaluation (NeurIPS 2023)
  ☆52Updated last year
• Lizw14 / Super-CLEVR
  Code for paper "Super-CLEVR: A Virtual Benchmark to Diagnose Domain Robustness in Visual Reasoning"
  ☆23Updated last year
• seonwoo-min / GVRT
  [ECCV-2022]Grounding Visual Representations with Texts for Domain Generalization
  ☆32Updated last year
• fmthoker / SEVERE-BENCHMARK
  ☆25Updated last year
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 4 months ago
• orrzohar / LOVM
  [NeurIPS 2023] Official Pytorch code for LOVM: Language-Only Vision Model Selection
  ☆20Updated 9 months ago
• ninatu / howtocaption
  Official implementation of "HowToCaption: Prompting LLMs to Transform Video Annotations at Scale." ECCV 2024
  ☆45Updated last month
• TencentARC / TaCA
  Official code for the paper, "TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter".
  ☆16Updated last year