Alternatives and similar repositories for TARA:

Users that are interested in TARA are comparing it to the libraries listed below

• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆80Updated 10 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆20Updated 10 months ago
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆16Updated 11 months ago
• LisaAnne / Hallucination
  ☆66Updated 6 years ago
• ChenyuHeidiZhang / VL-commonsense
  ☆15Updated 2 years ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆117Updated 2 years ago
• xxxiaol / spatial-commonsense
  Source code and data for Things not Written in Text: Exploring Spatial Commonsense from Visual Signals (ACL2022 main conference paper).
  ☆19Updated 2 years ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆70Updated 4 months ago
• edchengg / oven_eval
  ICCV 2023 (Oral) Open-domain Visual Entity Recognition Towards Recognizing Millions of Wikipedia Entities
  ☆38Updated 7 months ago
• IntelLabs / lvlm-interpret
  ☆71Updated last week
• koalazf99 / tacube
  [EMNLP 2022] TaCube: Pre-computing Data Cubes for Answering Numerical-Reasoning Questions over Tabular Data
  ☆17Updated last year
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆77Updated last year
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆47Updated last year
• MichaelZhouwang / VLUE
  This repo contains codes and instructions for baselines in the VLUE benchmark.
  ☆41Updated 2 years ago
• chingyaoc / debias_vl
  Code for Debiasing Vision-Language Models via Biased Prompts
  ☆57Updated last year
• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 3 years ago
• bcdnlp / FAITHSCORE
  ☆28Updated 3 weeks ago
• xlang-ai / icl-selective-annotation
  [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners"
  ☆109Updated last year
• IDEA-FinAI / ChartBench
  ☆11Updated 2 weeks ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• Maxlinn / CHAIR-metric-standalone
  CHAIR metric is a rule-based metric for evaluating object hallucination in caption generation.
  ☆27Updated last year
• open-vision-language / oven
  ☆34Updated last year
• lezhang7 / MOQAGPT
  [EMNLP'2023 Findings] MoqaGPT, for zero-shot multimodal question answering with LLMs
  ☆12Updated 3 months ago
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• DavidMChan / clair
  CLAIR: A (surprisingly) simple semantic text metric with large language models.
  ☆18Updated last year
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆136Updated last year
• Hxyou / IdealGPT
  Official Code of IdealGPT
  ☆34Updated last year
• RenShuhuai-Andy / my-tools
  my commonly-used tools
  ☆51Updated 2 months ago
• patrick-tssn / Awesome-Multimodal-Memory
  Reading List of Memory Augmented Multimodal Research, including multimodal context modeling, memory in vision and robotics, and external …
  ☆13Updated 6 months ago
• THUNLP-MT / ModelCompose
  Official code for our paper "Model Composition for Multimodal Large Language Models" (ACL 2024)
  ☆25Updated 2 months ago