Alternatives and similar repositories for InstructBLIP_PEFT

Users that are interested in InstructBLIP_PEFT are comparing it to the libraries listed below

• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆146Updated last year
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆83Updated 7 months ago
• Jiaxuan-Li / EVCap
  [CVPR 2024] Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension
  ☆51Updated last year
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆126Updated 11 months ago
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆47Updated last year
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆81Updated last year
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆88Updated last year
• amazon-science / QA-ViT
  ☆65Updated 10 months ago
• RUCAIBox / POPE
  The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆207Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆32Updated 2 years ago
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆21Updated 5 months ago
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆61Updated 8 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆84Updated last year
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆63Updated 10 months ago
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆78Updated 3 months ago
• yaolinli / DeCo
  ☆37Updated 10 months ago
• xuanlinli17 / large_vlm_distillation_ood
  Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)
  ☆58Updated last year
• gyxxyg / TRACE
  [ICLR 2025] TRACE: Temporal Grounding Video LLM via Casual Event Modeling
  ☆97Updated 4 months ago
• xing0047 / cca-llava
  [NeurIPS 2024] Mitigating Object Hallucination via Concentric Causal Attention
  ☆56Updated 5 months ago
• chuangchuangtan / LLaVA-NeXT-Image-Llama3-Lora
  LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft
  ☆44Updated 10 months ago
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆56Updated 4 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆90Updated 4 months ago
• jameelhassan / PromptAlign
  [NeurIPS 2023] Align Your Prompts: Test-Time Prompting with Distribution Alignment for Zero-Shot Generalization
  ☆105Updated last year
• CHENGY12 / PLOT
  [ICLR2023] PLOT: Prompt Learning with Optimal Transport for Vision-Language Models
  ☆165Updated last year
• LALBJ / PAI
  [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
  ☆120Updated 7 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆165Updated 7 months ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆162Updated 11 months ago
• Liuziyu77 / RAR
  The official implementation of RAR
  ☆88Updated last year
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆50Updated 7 months ago