Alternatives and similar repositories for ViTAR

Users that are interested in ViTAR are comparing it to the libraries listed below

• AILab-CVC / M2PT
  [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  ☆99Updated last year
• qhfan / RALA
  [CVPR2025] Breaking the Low-Rank Dilemma of Linear Attention
  ☆25Updated 4 months ago
• MambaMixer / M2
  ☆47Updated last year
• deepglint / RWKV-CLIP
  [EMNLP 2024] RWKV-CLIP: A Robust Vision-Language Representation Learner
  ☆137Updated 2 months ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆66Updated last year
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆134Updated last month
• aleemsidra / ConvLoRA
  This repository contains the pytorch code for our work IEEE ISBI 2024 paper "ConvLoRA and AdaBN Based Domain Adaptation via Self-Training…
  ☆80Updated 9 months ago
• m1k2zoo / negbench
  Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"
  ☆27Updated 2 months ago
• MzeroMiko / mamba-mini
  An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…
  ☆93Updated last year
• OliverRensu / ARM
  [ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆82Updated last month
• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆56Updated 8 months ago
• SJTU-DeepVisionLab / FLoRA
  ☆39Updated 11 months ago
• hammoudhasan / DiffCLIP
  Official Implementation of DiffCLIP: Differential Attention Meets CLIP
  ☆36Updated 4 months ago
• ViTAE-Transformer / QFormer
  The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"
  ☆217Updated last year
• bwconrad / flexivit
  PyTorch reimplementation of FlexiViT: One Model for All Patch Sizes
  ☆62Updated last year
• CompVis / discrete-interpolants
  The official implementation of "[MASK] is All You Need"
  ☆121Updated 4 months ago
• ethanbar11 / ssm_2d
  More dimensions = More fun
  ☆22Updated 11 months ago
• AstraZeneca / vlm
  Official implementation for "Diffusion Instruction Tuning"
  ☆23Updated last month
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆41Updated 6 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆224Updated last year
• iancovert / locality-alignment
  ☆50Updated 6 months ago
• Expedit-LargeScale-Vision-Transformer / Expedit-SAM
  [NeurIPS2022] This is the official implementation of the paper "Expediting Large-Scale Vision Transformer for Dense Prediction without Fi…
  ☆85Updated last year
• WenjunHuang94 / ML-Mamba
  ML-Mamba: Efficient Multi-Modal Large Language Model Utilizing Mamba-2
  ☆66Updated 8 months ago
• bwconrad / soft-moe
  PyTorch implementation of "From Sparse to Soft Mixtures of Experts"
  ☆58Updated last year
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆107Updated 3 months ago
• badripatro / mamba360
  State Space Models
  ☆68Updated last year
• Haochen-Wang409 / HPM
  [CVPR'23 & TPAMI'25] Hard Patches Mining for Masked Image Modeling
  ☆98Updated 3 months ago
• kyegomez / Vit-RGTS
  Open source implementation of "Vision Transformers Need Registers"
  ☆184Updated 3 months ago
• khawar-islam / diffuseMix
  Official PyTorch implementation of DiffuseMix : Label-Preserving Data Augmentation with Diffusion Models (CVPR'2024)
  ☆118Updated 4 months ago
• ChenDelong1999 / subobjects
  Official repository of paper "Subobject-level Image Tokenization" (ICML-25)
  ☆78Updated 2 weeks ago