Alternatives and similar repositories for ViTAR

Users that are interested in ViTAR are comparing it to the libraries listed below

• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆226Updated last year
• AILab-CVC / M2PT
  [CVPR 2024] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  ☆99Updated last year
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆136Updated 2 months ago
• ViTAE-Transformer / QFormer
  The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"
  ☆218Updated last year
• MzeroMiko / mamba-mini
  An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…
  ☆93Updated last year
• yuecao0119 / MMFuser
  The official implementation of the paper "MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding". …
  ☆57Updated 9 months ago
• DAMO-NLP-SG / Inf-CLIP
  [CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for C…
  ☆263Updated 7 months ago
• Beckschen / ViTamin
  [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"
  ☆209Updated last year
• bwconrad / flexivit
  PyTorch reimplementation of FlexiViT: One Model for All Patch Sizes
  ☆62Updated last year
• hammoudhasan / DiffCLIP
  Official Implementation of DiffCLIP: Differential Attention Meets CLIP
  ☆42Updated 5 months ago
• aleemsidra / ConvLoRA
  This repository contains the pytorch code for our work IEEE ISBI 2024 paper "ConvLoRA and AdaBN Based Domain Adaptation via Self-Training…
  ☆81Updated 10 months ago
• MambaMixer / M2
  ☆47Updated last year
• m1k2zoo / negbench
  Evaluation and dataset construction code for the CVPR 2025 paper "Vision-Language Models Do Not Understand Negation"
  ☆30Updated 4 months ago
• badripatro / mamba360
  State Space Models
  ☆70Updated last year
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆66Updated last year
• RobinWu218 / ToST
  [ICLR 2025 Spotlight] Official Implementation for ToST (Token Statistics Transformer)
  ☆114Updated 6 months ago
• iancovert / locality-alignment
  ☆52Updated 7 months ago
• OliverRensu / ARM
  [ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆84Updated 3 months ago
• UMass-Embodied-AGI / FlexAttention
  [ECCV 2024] FlexAttention for Efficient High-Resolution Vision-Language Models
  ☆43Updated 7 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆88Updated last year
• deepglint / RWKV-CLIP
  [EMNLP 2024] RWKV-CLIP: A Robust Vision-Language Representation Learner
  ☆141Updated 3 months ago
• wangf3014 / Mamba-Reg
  ☆72Updated 6 months ago
• kyegomez / MoE-Mamba
  Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Ze…
  ☆110Updated 2 weeks ago
• kyegomez / NaViT
  My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"
  ☆252Updated 2 weeks ago
• kyegomez / Vit-RGTS
  Open source implementation of "Vision Transformers Need Registers"
  ☆188Updated 2 weeks ago
• TempleX98 / MoVA
  [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context
  ☆166Updated 11 months ago
• yeruoforever / Awesome-Mamba
  Awsome works based on SSM and Mamba
  ☆17Updated last year
• LeapLabTHU / InLine
  Official repository of InLine attention (NeurIPS 2024)
  ☆54Updated 8 months ago
• SHI-Labs / OLA-VLM
  OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024
  ☆60Updated 6 months ago
• nickjiang2378 / test-time-registers
  Official Pytorch implementation of "Vision Transformers Don't Need Trained Registers"
  ☆93Updated 2 months ago