claws-lab / projection-in-MLLMs

Related projects ⓘ

Alternatives and complementary repositories for projection-in-MLLMs

• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆34Updated 8 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• UMass-Foundation-Model / CoVLM
  Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆42Updated last year
• d-ailin / CLIP-Guided-Decoding
  ☆13Updated 3 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆30Updated this week
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆41Updated 4 months ago
• rabiulcste / vqazero
  visual question answering prompting recipes for large vision-language models
  ☆22Updated 2 months ago
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated last month
• pleaseconnectwifi / DANCE
  PyTorch code for Improving Commonsense in Vision-Language Models via Knowledge Graph Riddles (DANCE)
  ☆24Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆45Updated 5 months ago
• StanfordMIMI / villa
  ViLLA: Fine-grained vision-language representation learning from real-world data
  ☆40Updated last year
• junyangwang0410 / HaELM
  An automatic MLLM hallucination detection framework
  ☆17Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆32Updated last week
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆54Updated 5 months ago
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆41Updated last year
• JiwanChung / vlis
  ☆24Updated last year
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆33Updated 3 weeks ago
• UMass-Foundation-Model / FlexAttention
  ☆30Updated last month
• edchengg / oven_eval
  ICCV 2023 (Oral) Open-domain Visual Entity Recognition Towards Recognizing Millions of Wikipedia Entities
  ☆33Updated 2 months ago
• gzcch / Bingo
  ☆53Updated 7 months ago
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆135Updated 6 months ago
• Yui010206 / CREMA
  ☕️ CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion
  ☆27Updated 5 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆73Updated 6 months ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆16Updated 5 months ago
• jiaangli / VLCA
  Do Vision and Language Models Share Concepts? A Vector Space Alignment Study
  ☆12Updated last month
• archiki / RepARe
  ☆19Updated last year
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆73Updated 7 months ago
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆25Updated 11 months ago
• lezhang7 / Enhance-FineGrained
  [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding
  ☆41Updated 3 months ago