Alternatives and similar repositories for attention-transfer

Users that are interested in attention-transfer are comparing it to the libraries listed below

• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆84Updated last year
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆47Updated last year
• OliverRensu / ARM
  [ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆85Updated 4 months ago
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆73Updated 5 months ago
• sarahESL / AlignCLIP
  AlignCLIP: Improving Cross-Modal Alignment in CLIP (ICLR 2025)
  ☆48Updated 7 months ago
• Haochen-Wang409 / DropPos
  [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
  ☆61Updated last year
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆90Updated last year
• zihuixue / MFH
  [ICLR 23 oral] The Modality Focusing Hypothesis: Towards Understanding Crossmodal Knowledge Distillation
  ☆45Updated 2 years ago
• tripletclip / TripletCLIP
  [NeurIPS 2024] Official PyTorch implementation of "Improving Compositional Reasoning of CLIP via Synthetic Vision-Language Negatives"
  ☆44Updated 10 months ago
• mlvlab / DAPT
  Distribution-Aware Prompt Tuning for Vision-Language Models (ICCV 2023)
  ☆43Updated last year
• runtsang / VFPT
  【NeurIPS 2024】Official implementation of "Visual Fourier Prompt Tuning"
  ☆33Updated 8 months ago
• JieShibo / PETL-ViT
  [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass
  ☆194Updated 2 years ago
• meetdavidwan / crg
  PyTorch code for "Contrastive Region Guidance: Improving Grounding in Vision-Language Models without Training"
  ☆36Updated last year
• ziplab / SPT
  [ICCV 2023 oral] This is the official repository for our paper: ''Sensitivity-Aware Visual Parameter-Efficient Fine-Tuning''.
  ☆72Updated 2 years ago
• yaolinli / DeCo
  Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language models
  ☆71Updated 2 months ago
• mlvlab / ProMetaR
  Official implementation of CVPR 2024 paper "Prompt Learning via Meta-Regularization".
  ☆29Updated 7 months ago
• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆59Updated 11 months ago
• peterant330 / KUEA
  [ICML'25] Kernel-based Unsupervised Embedding Alignment for Enhanced Visual Representation in Vision-language Models
  ☆17Updated last month
• PalAvik / hycoclip
  Code for the paper "Compositional Entailment Learning for Hyperbolic Vision-Language Models".
  ☆83Updated 3 months ago
• William-wAng618 / M2PT
  Official repo of M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning
  ☆27Updated 6 months ago
• techmonsterwang / iLLaMA
  Adapting LLaMA Decoder to Vision Transformer
  ☆30Updated last year
• wangf3014 / Patch_Scaling
  Official implementation of Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More
  ☆23Updated 7 months ago
• mzhaoshuai / RLCF
  [ICLR 2024] Test-Time Adaptation with CLIP Reward for Zero-Shot Generalization in Vision-Language Models.
  ☆92Updated last year
• scale-lab / MTLoRA
  The official implementation for MTLoRA: A Low-Rank Adaptation Approach for Efficient Multi-Task Learning (CVPR '24)
  ☆66Updated 3 months ago
• heliossun / SQ-LLaVA
  Visual self-questioning for large vision-language assistant.
  ☆45Updated 2 months ago
• lloongx / DIKI
  [ECCV 2024] Mind the Interference: Retaining Pre-trained Knowledge in Parameter Efficient Continual Learning of Vision-Language Models
  ☆53Updated last year
• SHI-Labs / Diffusion-Driven-Test-Time-Adaptation-via-Synthetic-Domain-Alignment
  Everything to the Synthetic: Diffusion-driven Test-time Adaptation via Synthetic-Domain Alignment, arXiv 2024 / CVPR 2025
  ☆33Updated 7 months ago
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆50Updated last year
• thunlp / DeepPerception
  DeepPerception: Advancing R1-like Cognitive Visual Perception in MLLMs for Knowledge-Intensive Visual Grounding
  ☆66Updated 4 months ago
• Zi-hao-Wei / Efficient-Vision-Language-Pre-training-by-Cluster-Masking
  [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.
  ☆29Updated last year