Alternatives and similar repositories for oven_eval

Users that are interested in oven_eval are comparing it to the libraries listed below

• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆99Updated last year
• open-vision-language / infoseek
  ☆64Updated last year
• open-vision-language / oven
  ☆40Updated 2 years ago
• bcdnlp / FAITHSCORE
  FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models
  ☆30Updated 6 months ago
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆85Updated last year
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆150Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆25Updated last year
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆21Updated 9 months ago
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆65Updated 2 weeks ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆55Updated 11 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆94Updated last month
• allenai / close
  ☆59Updated 2 years ago
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆93Updated last year
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆48Updated last year
• MrZilinXiao / AutoVER
  [ECCV'24] Official Implementation of Autoregressive Visual Entity Recognizer.
  ☆14Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆88Updated last year
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆16Updated last year
• Jiaxuan-Li / EVCap
  [CVPR 2024] Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension
  ☆55Updated last year
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆50Updated 2 months ago
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆24Updated 10 months ago
• aimagelab / pacscore
  [CVPR 2023 & IJCV 2025] Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation
  ☆64Updated 2 months ago
• LisaAnne / Hallucination
  ☆79Updated 6 years ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆37Updated 2 years ago
• vinid / neg_clip
  NegCLIP.
  ☆35Updated 2 years ago
• chuangchuangtan / LLaVA-NeXT-Image-Llama3-Lora
  LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft
  ☆44Updated last year
• mertyg / vision-language-models-are-bows
  Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …
  ☆286Updated 2 years ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆129Updated 2 years ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 3 years ago