yale-nlp / TOMATO

Related projects ⓘ

Alternatives and complementary repositories for TOMATO

• lscpku / VITATECS
  ☆17Updated 4 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆33Updated 2 weeks ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆45Updated 5 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆41Updated 4 months ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆17Updated last month
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆12Updated this week
• RifleZhang / LLaVA-Reasoner-DPO
  ☆30Updated this week
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆22Updated 2 weeks ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 5 months ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• yaolinli / DeCo
  ☆24Updated 4 months ago
• orrzohar / Video-STaR
  Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆47Updated 4 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆30Updated last month
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆35Updated last year
• RUCAIBox / Event-Bench
  Official code of *Towards Event-oriented Long Video Understanding*
  ☆12Updated 3 months ago
• lancopku / clip-openness
  [ACL 2023] Delving into the Openness of CLIP
  ☆23Updated last year
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated last month
• Letian2003 / C-VQA
  Counterfactual Reasoning VQA Dataset
  ☆24Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆16Updated 5 months ago
• zwq2018 / Multi-modal-Self-instruct
  The codebase for our EMNLP24 paper: Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Mo…
  ☆55Updated last month
• pengts / VW-LMM
  ☆23Updated 6 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆59Updated 5 months ago
• RainBowLuoCS / DEEM
  DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆15Updated 3 months ago
• GasolSun36 / MVP
  Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning
  ☆17Updated 2 months ago
• d-ailin / CLIP-Guided-Decoding
  ☆13Updated 3 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• Qinyu-Allen-Zhao / LVLM-LP
  The First to Know: How Token Distributions Reveal Hidden Knowledge in Large Vision-Language Models?
  ☆20Updated 3 weeks ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆30Updated last month
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆73Updated 7 months ago