Alternatives and similar repositories for InstructBLIP_PEFT:

Users that are interested in InstructBLIP_PEFT are comparing it to the libraries listed below

• Jiaxuan-Li / EVCap
  [CVPR 2024] Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension
  ☆48Updated 11 months ago
• opendatalab / HA-DPO
  Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization
  ☆82Updated last year
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆46Updated last year
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆80Updated 11 months ago
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆76Updated 4 months ago
• YiyangZhou / LURE
  [ICLR 2024] Analyzing and Mitigating Object Hallucination in Large Vision-Language Models
  ☆143Updated 10 months ago
• RUCAIBox / POPE
  The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆199Updated 11 months ago
• RitaRamo / smallcap
  SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  ☆100Updated last year
• vinid / neg_clip
  NegCLIP.
  ☆32Updated 2 years ago
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆112Updated 8 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆69Updated 4 months ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• Becomebright / GroundVQA
  Official PyTorch code of GroundVQA (CVPR'24)
  ☆56Updated 6 months ago
• Go2Heart / EchoSight
  [EMNLP 2024 Findings] The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
  ☆54Updated 2 months ago
• ys-zong / VL-ICL
  [ICLR 2025] VL-ICL Bench: The Devil in the Details of Multimodal In-Context Learning
  ☆47Updated last month
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆68Updated 9 months ago
• mrwu-mac / R-Bench
  [ICML2024] Repo for the paper `Evaluating and Analyzing Relationship Hallucinations in Large Vision-Language Models'
  ☆20Updated 2 months ago
• Liuziyu77 / RAR
  The official implementation of RAR
  ☆82Updated 11 months ago
• chuangchuangtan / LLaVA-NeXT-Image-Llama3-Lora
  LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft
  ☆44Updated 7 months ago
• RupertLuo / VoCoT
  VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models
  ☆48Updated 8 months ago
• HJYao00 / DenseConnector
  【NeurIPS 2024】Dense Connector for MLLMs
  ☆156Updated 5 months ago
• heliossun / SQ-LLaVA
  Visual self-questioning for large vision-language assistant.
  ☆40Updated 5 months ago
• mrwu-mac / ControlMLLM
  [NeurIPS2024] Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆148Updated last month
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆79Updated 11 months ago
• yellow-binary-tree / HawkEye
  Official implementation of HawkEye: Training Video-Text LLMs for Grounding Text in Videos
  ☆38Updated 10 months ago
• yaolinli / DeCo
  ☆29Updated 8 months ago
• mlvlab / Flipped-VQA
  Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)
  ☆74Updated 7 months ago
• yuezih / less-is-more
  Less is More: Mitigating Multimodal Hallucination from an EOS Decision Perspective (ACL 2024)
  ☆43Updated 4 months ago
• gyxxyg / TRACE
  [ICLR 2025] TRACE: Temporal Grounding Video LLM via Casual Event Modeling
  ☆72Updated last month
• LALBJ / PAI
  [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
  ☆104Updated 4 months ago