Alternatives and similar repositories for blip-vqa-finetune:

Users that are interested in blip-vqa-finetune are comparing it to the libraries listed below

• om-ai-lab / GroundVLP
  GroundVLP: Harnessing Zero-shot Visual Grounding from Vision-Language Pre-training and Open-Vocabulary Object Detection (AAAI 2024)
  ☆65Updated last year
• yuhangzang / ContextDET
  Contextual Object Detection with Multimodal Large Language Models
  ☆234Updated 6 months ago
• WisconsinAIVision / ViP-LLaVA
  [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts
  ☆319Updated 9 months ago
• kyegomez / PALI
  Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"
  ☆89Updated last year
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆154Updated 7 months ago
• wangjunchi / LLMSeg
  LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning
  ☆150Updated last year
• xk-huang / segment-caption-anything
  [CVPR 24] The repository provides code for running inference and training for "Segment and Caption Anything" (SCA) , links for downloadin…
  ☆220Updated 6 months ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆145Updated 3 weeks ago
• aimagelab / LLaVA-MORE
  LLaVA-MORE: A Comparative Study of LLMs and Visual Backbones for Enhanced Visual Instruction Tuning
  ☆129Updated 3 weeks ago
• ArrowLuo / SegCLIP
  PyTorch implementation of ICML 2023 paper "SegCLIP: Patch Aggregation with Learnable Centers for Open-Vocabulary Semantic Segmentation"
  ☆90Updated last year
• sMamooler / CLIP_Explainability
  code for studying OpenAI's CLIP explainability
  ☆31Updated 3 years ago
• damian0815 / finetune-clip-huggingface
  Finetuning CLIP on a small image/text dataset using huggingface libs
  ☆47Updated 2 years ago
• NExT-ChatV / NExT-Chat
  The code of the paper "NExT-Chat: An LMM for Chat, Detection and Segmentation".
  ☆238Updated last year
• yangbang18 / MultiCapCLIP
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆35Updated 8 months ago
• mbzuai-oryx / Video-LLaVA
  PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models
  ☆256Updated last year
• amazon-science / QA-ViT
  ☆65Updated 9 months ago
• waltonfuture / InstructionGPT-4
  InstructionGPT-4
  ☆39Updated last year
• LeapLabTHU / GSVA
  [CVPR2024] GSVA: Generalized Segmentation via Multimodal Large Language Models
  ☆131Updated 7 months ago
• heliossun / SQ-LLaVA
  Visual self-questioning for large vision-language assistant.
  ☆41Updated 6 months ago
• SHI-Labs / CuMo
  CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts
  ☆147Updated 10 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆90Updated 3 months ago
• 2U1 / SmolVLM-Finetune
  An open-source implementaion for fine-tuning SmolVLM.
  ☆25Updated 3 weeks ago
• AttentionX / InstructBLIP_PEFT
  ☆38Updated 4 months ago
• Hodasia / Awesome-Vision-Language-Finetune
  Awesome List of Vision Language Prompt Papers
  ☆46Updated last year
• LilyDaytoy / OpenPVSG
  Benchmarking Panoptic Video Scene Graph Generation (PVSG), CVPR'23
  ☆89Updated 11 months ago
• linyq2117 / TagCLIP
  [AAAI 2024] TagCLIP: A Local-to-Global Framework to Enhance Open-Vocabulary Multi-Label Classification of CLIP Without Training
  ☆82Updated last year
• Beckschen / ViTamin
  [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"
  ☆203Updated 10 months ago
• FreedomIntelligence / ALLaVA
  Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model
  ☆260Updated 10 months ago
• RitaRamo / smallcap
  SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  ☆107Updated last year
• Liuziyu77 / RAR
  The official implementation of RAR
  ☆86Updated last year