Alternatives and similar repositories for CLIP-Guided-Decoding

Users that are interested in CLIP-Guided-Decoding are comparing it to the libraries listed below

• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆33Updated 2 years ago
• junyangwang0410 / HaELM
  An automatic MLLM hallucination detection framework
  ☆19Updated last year
• yiren-jian / BLIText
  [NeurIPS 2023] Bootstrapping Vision-Language Learning with Decoupled Language Pre-training
  ☆25Updated last year
• FreedomIntelligence / TRIM
  We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…
  ☆14Updated 9 months ago
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆49Updated 10 months ago
• JiwanChung / vlis
  ☆24Updated last year
• lancopku / clip-openness
  [ACL 2023] Delving into the Openness of CLIP
  ☆23Updated 2 years ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆45Updated 10 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆48Updated last year
• archiki / RepARe
  ☆20Updated last year
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆88Updated last year
• bcdnlp / FAITHSCORE
  FaithScore: Fine-grained Evaluations of Hallucinations in Large Vision-Language Models
  ☆30Updated 6 months ago
• gzcch / Bingo
  ☆55Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆80Updated 10 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆52Updated last year
• kaistAI / Volcano
  [NAACL 2024] Vision language model that reduces hallucinations through self-feedback guided revision. Visualizes attentions on image feat…
  ☆46Updated last year
• SivanDoveh / DAC
  Repository for the paper: dense and aligned captions (dac) promote compositional reasoning in vl models
  ☆27Updated last year
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago
• ImKeTT / ZeroGen
  [NLPCC'23] ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles PyTorch Implementation
  ☆13Updated last year
• lscpku / VITATECS
  ☆18Updated last year
• BatsResearch / ex2
  If CLIP Could Talk: Understanding Vision-Language Model Representations Through Their Preferred Concept Descriptions
  ☆17Updated last year
• yfzhang114 / LLaVA-Align
  [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…
  ☆82Updated 6 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆55Updated 10 months ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆46Updated 10 months ago
• uqzhichen / Awesome-compositional-zero-shot-learning
  Paper list of compositional zero-shot learning
  ☆10Updated 3 years ago
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆80Updated last year
• codezakh / LilT
  [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning
  ☆40Updated 2 years ago
• sIncerass / MVLPT
  code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720
  ☆57Updated last year
• haoyiq114 / VALOR
  Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models (ACL-Findings 2024)
  ☆16Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago