young-geng / m3ae_public
Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
☆103Updated 2 months ago
Alternatives and similar repositories for m3ae_public:
Users that are interested in m3ae_public are comparing it to the libraries listed below
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆153Updated 2 years ago
- ☆63Updated 2 years ago
- PyTorch implementation of the paper "MILAN: Masked Image Pretraining on Language Assisted Representation" https://arxiv.org/pdf/2208.0604…☆82Updated 2 years ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆108Updated last year
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆159Updated last year
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆91Updated last year
- ☆48Updated 2 years ago
- PyTorch implementation of LIMoE☆53Updated last year
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆148Updated 2 years ago
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆83Updated 3 years ago
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆68Updated 3 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- ☆58Updated last year
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆66Updated last year
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆107Updated 2 weeks ago
- The Continual Learning in Multimodality Benchmark☆67Updated last year
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆205Updated 2 years ago
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆54Updated last year
- [TMLR 2022] High-Modality Multimodal Transformer☆114Updated 5 months ago
- (NeurIPS 2022) Self-Supervised Visual Representation Learning with Semantic Grouping☆98Updated last month
- ☆117Updated 2 years ago
- ☆61Updated last year
- code release of research paper "Exploring Long-Sequence Masked Autoencoders"☆100Updated 2 years ago
- Pytorch Implementation of paper "Object-Centric Learning with Slot Attention"☆91Updated last year
- [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"☆234Updated last year
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆33Updated last year
- ☆64Updated last year
- ☆154Updated 2 years ago
- S-CLIP: Semi-supervised Vision-Language Pre-training using Few Specialist Captions☆48Updated last year
- A PyTorch implementation of Mugs proposed by our paper "Mugs: A Multi-Granular Self-Supervised Learning Framework".☆83Updated last year