young-geng / m3ae_publicLinks
Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
☆104Updated 5 months ago
Alternatives and similar repositories for m3ae_public
Users that are interested in m3ae_public are comparing it to the libraries listed below
Sorting:
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆149Updated 2 years ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆158Updated 2 years ago
- ☆48Updated 3 years ago
- ☆120Updated 2 years ago
- ☆65Updated 3 years ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆94Updated last year
- PyTorch implementation of LIMoE☆53Updated last year
- PyTorch implementation of the paper "MILAN: Masked Image Pretraining on Language Assisted Representation" https://arxiv.org/pdf/2208.0604…☆83Updated 2 years ago
- [TMLR 2022] High-Modality Multimodal Transformer☆117Updated 9 months ago
- https://arxiv.org/abs/2209.15162☆50Updated 2 years ago
- code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720☆56Updated last year
- The Continual Learning in Multimodality Benchmark☆67Updated 2 years ago
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆176Updated last year
- Code used in "Understanding Dimensional Collapse in Contrastive Self-supervised Learning" paper.☆78Updated 2 years ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆111Updated last year
- [TPAMI] Searching prompt modules for parameter-efficient transfer learning.☆233Updated last year
- [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift☆38Updated last year
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆205Updated 2 years ago
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆33Updated 2 years ago
- A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.☆43Updated 3 years ago
- Pytorch Implementation of paper "Object-Centric Learning with Slot Attention"☆97Updated last year
- A PyTorch implementation of Mugs proposed by our paper "Mugs: A Multi-Granular Self-Supervised Learning Framework".☆83Updated last year
- [ICLR'23 Oral] Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matching☆253Updated last year
- Toolkit for Elevater Benchmark☆73Updated last year
- ImageNetV2 Pytorch Dataset☆41Updated 2 years ago
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆56Updated last year
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆70Updated last year
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆115Updated 4 months ago
- [ICLR 2023] Official code repository for "Meta Learning to Bridge Vision and Language Models for Multimodal Few-Shot Learning"☆59Updated 2 years ago
- Patching open-vocabulary models by interpolating weights☆91Updated last year