Alternatives and similar repositories for oven_eval:

Users that are interested in oven_eval are comparing it to the libraries listed below

• open-vision-language / oven
  ☆31Updated last year
• open-vision-language / infoseek
  ☆39Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆18Updated 8 months ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆26Updated last year
• bcdnlp / FAITHSCORE
  ☆28Updated 3 months ago
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated last month
• vinid / neg_clip
  NegCLIP.
  ☆30Updated 2 years ago
• LisaAnne / Hallucination
  ☆64Updated 5 years ago
• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 3 years ago
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆73Updated 9 months ago
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 2 months ago
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆76Updated last year
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆43Updated 7 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆67Updated 8 months ago
• JiwanChung / vlis
  ☆24Updated last year
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆45Updated last year
• hendryx-scale / mhal-detect
  M-HalDetect Dataset Release
  ☆21Updated last year
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated last year
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆41Updated last week
• MrZilinXiao / AutoVER
  [ECCV'24] Official Implementation of Autoregressive Visual Entity Recognizer.
  ☆12Updated 11 months ago
• OpenMatch / UniVL-DR
  [ICLR 2023] This is the code repo for our ICLR‘23 paper "Universal Vision-Language Dense Retrieval: Learning A Unified Representation Spa…
  ☆50Updated 7 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆39Updated 11 months ago
• lezhang7 / Enhance-FineGrained
  [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding
  ☆45Updated 6 months ago
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated last year
• RAIVNLab / CREPE
  [CVPR23 Highlight] CREPE: Can Vision-Language Foundation Models Reason Compositionally?
  ☆32Updated last year
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆41Updated 3 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆62Updated 3 months ago
• kaistAI / Volcano
  [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…
  ☆43Updated 5 months ago
• snumprlab / isr-dpo
  Official Implementation of ISR-DPO:Aligning Large Multimodal Models for Videos by Iterative Self-Retrospective DPO (AAAI'25)
  ☆14Updated last month