Alternatives and similar repositories for oven_eval

Users that are interested in oven_eval are comparing it to the libraries listed below

• open-vision-language / infoseek
  ☆56Updated last year
• bcdnlp / FAITHSCORE
  FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models
  ☆30Updated 4 months ago
• open-vision-language / oven
  ☆39Updated last year
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆96Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆147Updated last year
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆21Updated 7 months ago
• MrZilinXiao / AutoVER
  [ECCV'24] Official Implementation of Autoregressive Visual Entity Recognizer.
  ☆14Updated last year
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆82Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆34Updated 2 years ago
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆16Updated last year
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆87Updated last year
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆62Updated 6 months ago
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆49Updated 3 weeks ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆47Updated last year
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆90Updated last year
• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 3 years ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• LisaAnne / Hallucination
  ☆75Updated 6 years ago
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 8 months ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆127Updated 2 years ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆55Updated 9 months ago
• aimagelab / pacscore
  [CVPR 2023 & IJCV 2025] Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation
  ☆62Updated last week
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated 2 years ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆86Updated last year
• Jiaxuan-Li / EVCap
  [CVPR 2024] Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension
  ☆54Updated last year
• hendryx-scale / mhal-detect
  M-HalDetect Dataset Release
  ☆25Updated last year
• allenai / close
  ☆59Updated last year
• thunlp / PEVL
  Source code for EMNLP 2022 paper “PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models”
  ☆48Updated 2 years ago