Alternatives and similar repositories for VALSE:

Users that are interested in VALSE are comparing it to the libraries listed below

• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 3 years ago
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• redcaps-dataset / redcaps-downloader
  Command-line tool for downloading and extending the RedCaps dataset.
  ☆46Updated last year
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated 2 years ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• facebookresearch / reliable_vqa
  Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…
  ☆33Updated last year
• McGill-NLP / imagecode
  Code and data for ImageCoDe, a contextual vison-and-language benchmark
  ☆39Updated last year
• NVlabs / PALAVRA
  ☆50Updated 2 years ago
• jmhessel / pycocoevalcap
  Python 3 support for the MS COCO caption evaluation tools
  ☆14Updated 10 months ago
• google-research-datasets / Crisscrossed-Captions
  Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
  ☆51Updated 4 years ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆78Updated last year
• allenai / sherlock
  Code, data, models for the Sherlock corpus
  ☆57Updated 2 years ago
• e-bug / fine-grained-evals
  [ACL 2023] Code and data for our paper "Measuring Progress in Fine-grained Vision-and-Language Understanding"
  ☆13Updated last year
• zinengtang / Perceiver_VL
  PyTorch code for "Perceiver-VL: Efficient Vision-and-Language Modeling with Iterative Latent Attention" (WACV 2023)
  ☆33Updated 2 years ago
• lupantech / IconQA
  Data and code for NeurIPS 2021 Paper "IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoning".
  ☆52Updated last year
• LuoweiZhou / coco-caption
  kdexd/coco-caption@de6f385
  ☆26Updated 4 years ago
• MikeWangWZHL / VidIL
  Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners
  ☆114Updated 2 years ago
• zmykevin / UVLP
  CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
  ☆22Updated 3 years ago
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 2 years ago
• bcdnlp / FAITHSCORE
  ☆28Updated last month
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 4 months ago
• kakaobrain / noc
  ☆46Updated 11 months ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• google-research-datasets / maxm
  MaXM is a suite of test-only benchmarks for multilingual visual question answering in 7 languages: English (en), French (fr), Hindi (hi),…
  ☆13Updated last year
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆33Updated last year
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated 2 years ago
• RitaRamo / extra
  Retrieval-augmented Image Captioning
  ☆13Updated 2 years ago
• ExplainableML / CLEVR-X
  CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations
  ☆27Updated last year