AILab-CVC / M2PTLinks
[CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
☆99Updated last year
Alternatives and similar repositories for M2PT
Users that are interested in M2PT are comparing it to the libraries listed below
Sorting:
- Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"☆81Updated last year
- [CVPR 2024] ViT-Lens: Towards Omni-modal Representations☆174Updated 4 months ago
- [ICLR2025] This repository is the official implementation of our Autoregressive Pretraining with Mamba in Vision☆77Updated this week
- Official repository of paper "Subobject-level Image Tokenization"☆72Updated 2 months ago
- [CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training☆45Updated 2 months ago
- Open source implementation of "Vision Transformers Need Registers"☆177Updated last month
- Explore the Limits of Omni-modal Pretraining at Scale☆100Updated 9 months ago
- [ICML 2024] This repository includes the official implementation of our paper "Rejuvenating image-GPT as Strong Visual Representation Lea…☆98Updated last year
- [BMVC 2024] PlainMamba: Improving Non-hierarchical Mamba in Visual Recognition☆77Updated last month
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆124Updated 9 months ago
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆113Updated last month
- [NeurIPS2024 Spotlight] The official implementation of MambaTree: Tree Topology is All You Need in State Space Model☆92Updated 11 months ago
- [ICLR'25] Reconstructive Visual Instruction Tuning☆89Updated last month
- ☆31Updated last month
- 「AAAI 2024」 Referred by Multi-Modality: A Unified Temporal Transformers for Video Object Segmentation☆79Updated 11 months ago
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆215Updated last year
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆74Updated 3 months ago
- ☆61Updated last year
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆59Updated 3 months ago
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆105Updated 2 months ago
- Official code for paper "GRIT: Teaching MLLMs to Think with Images"☆55Updated last week
- [IEEE TCSVT] Official Pytorch Implementation of CLIP-VIS: Adapting CLIP for Open-Vocabulary Video Instance Segmentation.☆43Updated 4 months ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆205Updated 11 months ago
- [ICML 2025] Official Implementation for SimDINO/SimDINOv2☆136Updated 2 months ago
- ☆67Updated 3 months ago
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆163Updated last week
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception