Alternatives and similar repositories for PuMer

Users that are interested in PuMer are comparing it to the libraries listed below

• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆56Updated 8 months ago
• locuslab / llava-token-compression
  ☆42Updated 8 months ago
• Hon-Wong / ByteVideoLLM
  [ICCV 2025] Dynamic-VLM
  ☆21Updated 6 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• LaVi-Lab / Visual-Table
  [EMNLP 2024] Official code for "Beyond Embeddings: The Promise of Visual Table in Multi-Modal Models"
  ☆20Updated 8 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆55Updated 8 months ago
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆41Updated 6 months ago
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆49Updated last year
• FreedomIntelligence / TRIM
  We introduce new approach, Token Reduction using CLIP Metric (TRIM), aimed at improving the efficiency of MLLMs without sacrificing their…
  ☆15Updated 7 months ago
• mlvlab / DAPT
  Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)
  ☆41Updated last year
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆33Updated last year
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆41Updated 7 months ago
• findalexli / mllm-dpo
  [ACL 2024] Multi-modal preference alignment remedies regression of visual instruction tuning on language model
  ☆46Updated 8 months ago
• AGI-Edgerunners / IIL
  Code for our Paper "All in an Aggregated Image for In-Image Learning"
  ☆30Updated last year
• sdc17 / CrossGET
  [ICML 2024] CrossGET: Cross-Guided Ensemble of Tokens for Accelerating Vision-Language Transformers.
  ☆33Updated 6 months ago
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆64Updated last month
• iancovert / locality-alignment
  ☆50Updated 5 months ago
• JiwanChung / vlis
  ☆24Updated last year
• Saehyung-Lee / PlugIR
  Official repository of "Interactive Text-to-Image Retrieval with Large Language Models: A Plug-and-Play Approach" (ACL 2024 Oral)
  ☆29Updated 3 months ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆65Updated last year
• techmonsterwang / iLLaMA
  Adapting LLaMA Decoder to Vision Transformer
  ☆28Updated last year
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆46Updated 8 months ago
• Kevinz-code / SeVa
  [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501
  ☆56Updated 11 months ago
• hasanar1f / HiRED
  [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visio…
  ☆39Updated 2 months ago
• mlfoundations / VisIT-Bench
  ☆50Updated last year
• jeykigung / HiCLIP
  ☆29Updated 2 years ago
• alibaba / conv-llava
  ☆115Updated 11 months ago
• zehanwang01 / OmniBind
  ☆32Updated 3 months ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆42Updated 9 months ago