Alternatives and similar repositories for FlexAttention:

Users that are interested in FlexAttention are comparing it to the libraries listed below

• hasanar1f / HiRED
  [AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Visio…
  ☆28Updated 2 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 3 months ago
• techmonsterwang / iLLaMA
  Adapting LLaMA Decoder to Vision Transformer
  ☆28Updated 10 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆48Updated 4 months ago
• Shengcao-Cao / groundLMM
  Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision
  ☆38Updated last week
• palchenli / VL-Instruction-Tuning
  ☆91Updated last year
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 6 months ago
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆48Updated 10 months ago
• OpenGVLab / Mono-InternVL
  [CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
  ☆25Updated last week
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆59Updated last year
• alibaba / conv-llava
  ☆114Updated 8 months ago
• wusize / F-LMM
  [CVPR2025] Code Release of F-LMM: Grounding Frozen Large Multimodal Models
  ☆80Updated 7 months ago
• RifleZhang / LLaVA-Reasoner-DPO
  ☆70Updated 2 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆65Updated 10 months ago
• OpenGVLab / V2PE
  [ArXiv] V2PE: Improving Multimodal Long-Context Capability of Vision-Language Models with Variable Visual Position Encoding
  ☆31Updated 3 months ago
• Share14 / ShareGemini
  ☆29Updated 8 months ago
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆81Updated last year
• RUCAIBox / ComVint
  The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…
  ☆19Updated last year
• wangf3014 / Patch_Scaling
  Official implementation of Scaling Laws in Patchification: An Image Is Worth 50,176 Tokens And More
  ☆17Updated last month
• DeepLearnXMU / AVG-LLaVA
  Code for "AVG-LLaVA: A Multimodal Large Model with Adaptive Visual Granularity"
  ☆27Updated 5 months ago
• si0wang / VisVM
  ☆37Updated 3 months ago
• Hon-Wong / VoRA
  ☆16Updated last week
• Victorwz / Open-Qwen2VL
  Open-Qwen2VL: Compute-Efficient Pre-Training of Fully-Open Multimodal LLMs on Academic Resources
  ☆66Updated this week
• Yangyi-Chen / SOLO
  [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"
  ☆131Updated 4 months ago
• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆51Updated 4 months ago
• chancharikmitra / SAVs
  Official Codebase for "Generative Multimodal Model Features Are Discriminative Vision-Language Classifiers"
  ☆13Updated last week
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆54Updated 3 months ago
• core-mm / core-mm
  ☆17Updated last year
• csarron / PuMer
  [ACL 2023] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models
  ☆29Updated 6 months ago
• OpenGVLab / De-focus-Attention-Networks
  Learning 1D Causal Visual Representation with De-focus Attention Networks
  ☆32Updated 9 months ago