Alternatives and similar repositories for M2PT:

Users that are interested in M2PT are comparing it to the libraries listed below

• kyegomez / Vit-RGTS
  Open source implementation of "Vision Transformers Need Registers"
  ☆161Updated this week
• ChenDelong1999 / subobjects
  Official repository of paper "Subobject-level Image Tokenization"
  ☆64Updated 9 months ago
• TencentARC / ViT-Lens
  [CVPR 2024] ViT-Lens: Towards Omni-modal Representations
  ☆168Updated 6 months ago
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆80Updated 10 months ago
• UX-Decoder / FIND
  [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"
  ☆118Updated 5 months ago
• OliverRensu / D-iGPT
  [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…
  ☆97Updated 8 months ago
• FoundationVision / Liquid
  Liquid: Language Models are Scalable Multi-modal Generators
  ☆60Updated last month
• zh460045050 / V2L-Tokenizer
  ☆119Updated 7 months ago
• OpenGVLab / MUTR
  「AAAI 2024」 Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation
  ☆75Updated 7 months ago
• liuzhuang13 / bias
  ☆103Updated 10 months ago
• JiuTian-VL / MoME
  [NeurIPS 2024] MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Models
  ☆44Updated last month
• ziqipang / LM4VisualEncoding
  [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
  ☆230Updated last year
• zbr17 / OptVQ
  Towards training VQ-VAE models robustly!
  ☆43Updated 3 weeks ago
• MzeroMiko / mamba-mini
  An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…
  ☆78Updated 10 months ago
• invictus717 / MiCo
  Explore the Limits of Omni-modal Pretraining at Scale
  ☆96Updated 4 months ago
• JoakimHaurum / TokenReduction
  Official PyTorch implementation of Which Tokens to Use? Investigating Token Reduction in Vision Transformers presented at ICCV 2023 NIVT …
  ☆33Updated last year
• OliverRensu / ARM
  This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision
  ☆68Updated 7 months ago
• TonyLianLong / CrossMAE
  Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders
  ☆99Updated last month
• ChenhongyiYang / PlainMamba
  [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition
  ☆72Updated 5 months ago
• wangf3014 / Mamba-Reg
  ☆55Updated 7 months ago
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆170Updated last month
• EasonXiao-888 / GrootVL
  [NeurIPS2024 Spotlight] The official implementation of GrootVL: Tree Topology is All You Need in State Space Model
  ☆89Updated 7 months ago
• Beckschen / LLaVolta
  [NeurIPS 2024] Efficient Multi-modal Models via Stage-wise Visual Context Compression
  ☆51Updated 5 months ago
• Haochen-Wang409 / DropPos
  [NeurIPS'23] DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions
  ☆60Updated 9 months ago
• kevin-ssy / CLIP_as_RNN
  Official Implementation for CVPR 2024 paper: CLIP as RNN: Segment Countless Visual Concepts without Training Endeavor
  ☆104Updated 7 months ago
• MonoFormer / MonoFormer
  The official implementation for "MonoFormer: One Transformer for Both Diffusion and Autoregression"
  ☆81Updated 3 months ago
• yuhui-zh15 / VLMClassifier
  Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)
  ☆66Updated 3 months ago
• showlab / sparseformer
  (ICLR 2024, CVPR 2024) SparseFormer
  ☆69Updated 2 months ago
• layer6ai-labs / fusemix
  Data-Efficient Multimodal Fusion on a Single GPU
  ☆52Updated 8 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆124Updated last year