Alternatives and similar repositories for PuMer

Users that are interested in PuMer are comparing it to the libraries listed below

• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆60Updated last year
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆46Updated 10 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆52Updated 2 years ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆60Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated 2 years ago
• locuslab / llava-token-compression
  ☆45Updated last year
• techmonsterwang / iLLaMA
  Adapting LLaMA Decoder to Vision Transformer
  ☆30Updated last year
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆56Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated 2 years ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆48Updated last year
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆46Updated last year
• inclusionAI / M2-Reasoning
  M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoning
  ☆46Updated 4 months ago
• Saehyung-Lee / PlugIR
  Official repository of "Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach" (ACL 2024 Oral)
  ☆33Updated 8 months ago
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆50Updated last year
• Kwai-YuanQi / TaskGalaxy
  Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types
  ☆32Updated 4 months ago
• sdc17 / CrossGET
  [ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers
  ☆34Updated 11 months ago
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆26Updated 11 months ago
• THU-MIG / VTC-CLS
  official repo for paper "[CLS] Token Tells Everything Needed for Training-free Efficient MLLMs"
  ☆23Updated 7 months ago
• alibaba / conv-llava
  ☆124Updated last year
• JiwanChung / vlis
  ☆24Updated 2 years ago
• OoDBag / VisTA
  VisualToolAgent (VisTA): A Reinforcement Learning Framework for Visual Tool Selection
  ☆20Updated 6 months ago
• OpenGVLab / De-focus-Attention-Networks
  Learning 1D Causal Visual Representation with De-focus Attention Networks
  ☆35Updated last year
• FreedomIntelligence / TRIM
  We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…
  ☆16Updated 11 months ago
• GasolSun36 / MVP
  Look, Compare, Decide: Alleviating Hallucination in Large Vision-Language Models via Multi-View Multi-Path Reasoning
  ☆23Updated last year
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆49Updated last year
• jeykigung / HiCLIP
  ☆30Updated 2 years ago
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆29Updated last year
• Yaxin9Luo / Gamma-MOD
  [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models
  ☆40Updated last month
• iancovert / locality-alignment
  ☆53Updated 10 months ago
• Qinying-Liu / TagAlign
  Official implementation of TagAlign
  ☆35Updated 11 months ago