yuhui-zh15 / C3

Related projects ⓘ

Alternatives and complementary repositories for C3

• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆34Updated 8 months ago
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆51Updated last month
• orrzohar / Video-STaR
  Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆47Updated 4 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆73Updated 6 months ago
• ys-zong / VL-ICL
  Code for paper: VL-ICL Bench: The Devil in the Details of Benchmarking Multimodal In-Context Learning
  ☆28Updated 7 months ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆45Updated 5 months ago
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated last month
• DCDmllm / MorphTokens
  ☆43Updated 6 months ago
• yonseivnl / vlm-rlaif
  ACL'24 (Oral) Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
  ☆52Updated 2 months ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 5 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆56Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• IntelLabs / lvlm-interpret
  ☆47Updated 4 months ago
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆51Updated 2 months ago
• MikeWangWZHL / Paxion
  Repo for paper: "Paxion: Patching Action Knowledge in Video-Language Foundation Models" Neurips 23 Spotlight
  ☆35Updated last year
• arijitray1993 / COLA
  COLA: Evaluate how well your vision-language model can Compose Objects Localized with Attributes!
  ☆22Updated 5 months ago
• scofield7419 / Video-of-Thought
  Codes for ICML 2024 paper: "Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognition"
  ☆40Updated 4 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆59Updated 5 months ago
• lscpku / VITATECS
  ☆17Updated 4 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆73Updated 7 months ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆54Updated 5 months ago
• llyx97 / TempCompass
  [ACL 2024 Findings] "TempCompass: Do Video LLMs Really Understand Videos?", Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, …
  ☆89Updated last week
• vinid / neg_clip
  NegCLIP.
  ☆26Updated last year
• eric-ai-lab / MMWorld
  Official repo of the paper "MMWorld: Towards Multi-discipline Multi-faceted World Model Evaluation in Videos"
  ☆20Updated 2 months ago
• mu-cai / TemporalBench
  TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
  ☆22Updated last week
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆24Updated last month
• Liuziyu77 / MIA-DPO
  Official implement of MIA-DPO
  ☆40Updated 2 weeks ago
• sled-group / moh
  Official Repository of Multi-Object Hallucination in Vision-Language Models (NeurIPS 2024)
  ☆25Updated last week
• amazon-science / QA-ViT
  ☆55Updated 4 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆107Updated 4 months ago