[CVPR 2024] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
☆103Mar 13, 2024Updated 2 years ago
Alternatives and similar repositories for M2PT
Users that are interested in M2PT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [ICCV 2025] Explore the Limits of Omni-modal Pretraining at Scale☆126Sep 2, 2024Updated 2 years ago
- I2M2: Jointly Modeling Inter- & Intra-Modality Dependencies for Multi-modal Learning (NeurIPS 2024)☆21Oct 30, 2024Updated 2 years ago
- [ICLR 23] Contrastive Aligned of Vision to Language Through Parameter-Efficient Transfer Learning☆40Jul 29, 2023Updated 3 years ago
- A much powerful probing method to tune your model with promising performance and linear probing training cost!☆15Jul 26, 2023Updated 3 years ago
- Source code of the paper: Overlapped Trajectory-Enhanced Visual Tracking☆11Sep 3, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆22Jan 21, 2025Updated last year
- [CVPR 2024 & TPAMI 2025] UniRepLKNet☆1,076Aug 10, 2025Updated last year
- ☆10Oct 20, 2023Updated 3 years ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆667Oct 22, 2024Updated 2 years ago
- The repo for "Enhancing Multi-modal Cooperation via Sample-level Modality Valuation", CVPR 2024☆62Nov 5, 2024Updated last year
- Data-Efficient Multimodal Fusion on a Single GPU☆68May 7, 2024Updated 2 years ago
- The code for the paper "LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling" (NeurIPS'24).☆15Dec 25, 2024Updated last year
- MMPD Dataset from ECCV'2024 "When Pedestrian Detection Meets Multi-Modal Learning: Generalist Model and Benchmark Dataset"☆23Jul 15, 2024Updated 2 years ago
- [Pattern Recognition 2024] Semantic-Aware Frame-Event Fusion based Pattern Recognition via Large Vision-Language Models, Dong Li, Jiandon…☆18Jan 18, 2025Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Meta-Transformer for Unified Multimodal Learning☆1,644Dec 5, 2023Updated 2 years ago
- [CVPR 2024] ViT-Lens: Towards Omni-modal Representations☆189Feb 3, 2025Updated last year
- [CVPR2024] FCS: Feature Calibration and Separation for Non-Exemplar Class Incremental Learning☆20Apr 18, 2025Updated last year
- ☆27Nov 6, 2025Updated 11 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆376Jul 24, 2025Updated last year
- Keras (TensorFlow v2) reimplementation of Re-parameterized Large Kernel Network (RepLKNet)☆17Dec 8, 2022Updated 3 years ago
- ☆11Apr 27, 2023Updated 3 years ago
- SimpleVQA: Multimodal Factuality Evaluation for Multimodal Large Language Models☆15Feb 20, 2025Updated last year
- [MICCAI' 2025] EndoGen: Conditional Autoregressive Endoscopic Video Generation☆14Jun 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆27Jan 23, 2024Updated 2 years ago
- NeurIPS'2023 official implementation code☆70Nov 11, 2023Updated 2 years ago
- The official implementation of Cross-Task Experience Sharing (COPS)☆29Oct 23, 2024Updated 2 years ago
- The repo for "Diagnosing and Re-learning for Balanced Multi-modal Learning", ECCV 2024☆31Jul 30, 2024Updated 2 years ago
- Code for paper "LLMs Can Evolve Continually on Modality for X-Modal Reasoning" NeurIPS2024☆41Dec 18, 2024Updated last year
- ☆42Apr 16, 2024Updated 2 years ago
- DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistency (AAAI24)☆72Aug 20, 2024Updated 2 years ago
- ☆62Apr 28, 2025Updated last year
- Video + CLIP Baseline for Ego4D Long Term Action Anticipation Challenge (CVPR 2022)☆15Jul 4, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆17Apr 22, 2025Updated last year
- SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems☆87Jan 9, 2024Updated 2 years ago
- ☆18Apr 18, 2025Updated last year
- ☆15Dec 3, 2021Updated 4 years ago
- [MM2024, oral] "Self-Supervised Visual Preference Alignment" https://arxiv.org/abs/2404.10501☆61Jul 26, 2024Updated 2 years ago
- A tool to assist in the interpretation of learned features in sparse autoencoders (in particular the four SAE's trained by Joseph Bloom o…☆19Oct 4, 2024Updated 2 years ago
- ☆12Dec 19, 2024Updated last year