lscpku / VITATECS

Related projects ⓘ

Alternatives and complementary repositories for VITATECS

• yale-nlp / TOMATO
  ☆13Updated 2 weeks ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆35Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆16Updated 5 months ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 5 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆22Updated 2 weeks ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆41Updated 4 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆35Updated 3 weeks ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆45Updated 5 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆34Updated 2 weeks ago
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• longvideobench / LongVideoBench
  [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆66Updated 3 months ago
• yellow-binary-tree / HawkEye
  Official implementation of HawkEye: Training Video-Text LLMs for Grounding Text in Videos
  ☆34Updated 6 months ago
• zjuchenlong / WSAG
  [EMNLP'22] Weakly-Supervised Temporal Article Grounding
  ☆14Updated 11 months ago
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated last month
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆73Updated 8 months ago
• DAMO-NLP-SG / CMM
  ✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
  ☆30Updated last month
• patrick-tssn / VideoHallucer
  VideoHallucer, The first comprehensive benchmark for hallucination detection in large video-language models (LVLMs)
  ☆22Updated 4 months ago
• RifleZhang / LLaVA-Hound-DPO
  ☆121Updated 3 weeks ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆52Updated 2 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆34Updated 8 months ago
• yaolinli / DeCo
  ☆24Updated 4 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆89Updated last week
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• bcdnlp / FAITHSCORE
  ☆25Updated 2 weeks ago
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆30Updated last month
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆64Updated 6 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• vlf-silkie / VLFeedback
  ☆84Updated 11 months ago
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆41Updated last year