Alternatives and similar repositories for PVIT

Users that are interested in PVIT are comparing it to the libraries listed below

• RUCAIBox / ComVint
  The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…
  ☆19Updated 2 years ago
• palchenli / VL-Instruction-Tuning
  ☆91Updated 2 years ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆52Updated 2 years ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated 2 years ago
• mightyzau / RegionBLIP
  ☆58Updated 2 years ago
• TencentARC / FLM
  Accelerating Vision-Language Pretraining with Free Language Modeling (CVPR 2023)
  ☆32Updated 2 years ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆70Updated 9 months ago
• UMass-Embodied-AGI / CoVLM
  [ICLR 2023] CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding
  ☆46Updated 5 months ago
• SY-Xuan / Pink
  Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs
  ☆95Updated 10 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆65Updated last year
• Shengcao-Cao / groundLMM
  Emergent Visual Grounding in Large Multimodal Models Without Grounding Supervision
  ☆41Updated last month
• Share14 / ShareGemini
  ☆32Updated last year
• si0wang / VisVM
  ☆46Updated 11 months ago
• linzhiqiu / visual_gpt_score
  VisualGPTScore for visio-linguistic reasoning
  ☆27Updated 2 years ago
• heliossun / SQ-LLaVA
  Visual self-questioning for large vision-language assistant.
  ☆45Updated 4 months ago
• isekai-portal / Link-Context-Learning
  ☆100Updated last year
• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆72Updated last year
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆51Updated 8 months ago
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆50Updated last year
• callsys / ControlCap
  [ECCV 2024] ControlCap: Controllable Region-level Captioning
  ☆80Updated last year
• pkunlp-icler / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆50Updated 4 months ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆164Updated last year
• takomc / amp
  【NeurIPS 2024】The official code of paper "Automated Multi-level Preference for MLLMs"
  ☆20Updated last year
• xuanlinli17 / large_vlm_distillation_ood
  Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)
  ☆59Updated last year
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆49Updated last year
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆20Updated last year
• cliangyu / Cola
  [NeurIPS2023] Official implementation of the paper "Large Language Models are Visual Reasoning Coordinators"
  ☆104Updated 2 years ago
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆76Updated last year
• QQ-MM / PureMM
  ☆21Updated last year
• Ahnsun / merlin
  [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds
  ☆96Updated last year