BAAI-DCAI / Visual-Instruction-Tuning

Related projects: ⓘ

• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆74Updated 6 months ago
• X2FD / LVIS-INSTRUCT4V
  ☆128Updated 8 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆239Updated 2 months ago
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆244Updated 6 months ago
• RUCAIBox / POPE
  The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆166Updated 5 months ago
• Liuziyu77 / MMDU
  Official repository of MMDU dataset
  ☆61Updated last month
• RifleZhang / LLaVA-Hound-DPO
  ☆110Updated 4 months ago
• baaivision / EVE
  EVE: Encoder-Free Vision-Language Models
  ☆207Updated last month
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆114Updated 2 months ago
• amazon-science / prompt-pretraining
  Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
  ☆251Updated 4 months ago
• HJYao00 / DenseConnector
  Dense Connector for MLLMs
  ☆98Updated last month
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆67Updated 5 months ago
• MMStar-Benchmark / MMStar
  This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆138Updated 5 months ago
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆86Updated 4 months ago
• palchenli / VL-Instruction-Tuning
  ☆83Updated 9 months ago
• alibaba / conv-llava
  ☆100Updated last month
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆44Updated 3 weeks ago
• deepcs233 / Visual-CoT
  Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning
  ☆93Updated 2 months ago
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆251Updated 8 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆72Updated 3 months ago
• tsb0601 / MMVP
  ☆277Updated 7 months ago
• open-compass / MMBench
  Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
  ☆143Updated 2 weeks ago
• TideDra / VL-RLHF
  A RLHF Infrastructure for Vision-Language Models
  ☆86Updated 3 months ago
• thunlp / Muffin
  ☆53Updated 7 months ago
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆80Updated 2 months ago
• baaivision / CapsFusion
  [CVPR 2024] CapsFusion: Rethinking Image-Text Data at Scale
  ☆189Updated 6 months ago
• tianyi-lab / HallusionBench
  [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(…
  ☆220Updated 6 months ago
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆57Updated 2 months ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆303Updated 2 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆114Updated 8 months ago