young-geng / m3ae_publicLinks
Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation
☆103Updated 6 months ago
Alternatives and similar repositories for m3ae_public
Users that are interested in m3ae_public are comparing it to the libraries listed below
Sorting:
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆148Updated 2 years ago
- ☆64Updated 3 years ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆160Updated 2 years ago
- ☆120Updated 2 years ago
- The Continual Learning in Multimodality Benchmark☆67Updated 2 years ago
- PyTorch implementation of the paper "MILAN: Masked Image Pretraining on Language Assisted Representation" https://arxiv.org/pdf/2208.0604…☆83Updated 3 years ago
- PyTorch implementation of LIMoE☆52Updated last year
- ☆48Updated 3 years ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆97Updated 2 years ago
- [TPAMI] Searching prompt modules for parameter-efficient transfer learning.☆235Updated last year
- [TMLR 2022] High-Modality Multimodal Transformer☆117Updated 10 months ago
- code for "Multitask Vision-Language Prompt Tuning" https://arxiv.org/abs/2211.11720☆57Updated last year
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆181Updated 2 years ago
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆206Updated 2 years ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆110Updated last year
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆69Updated 3 years ago
- Toolkit for Elevater Benchmark☆74Updated last year
- Pytorch Implementation of paper "Object-Centric Learning with Slot Attention"☆100Updated last year
- Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)☆34Updated 2 years ago
- [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift☆38Updated last year
- https://arxiv.org/abs/2209.15162☆52Updated 2 years ago
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆84Updated 3 years ago
- Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".☆78Updated 2 years ago
- S-CLIP: Semi-supervised Vision-Language Pre-training using Few Specialist Captions☆48Updated 2 years ago
- ImageNetV2 Pytorch Dataset☆41Updated 2 years ago
- (NeurIPS 2022) Self-Supervised Visual Representation Learning with Semantic Grouping☆97Updated 6 months ago
- ☆65Updated last year
- Compress conventional Vision-Language Pre-training data☆52Updated 2 years ago
- SVL-Adapter: Self-Supervised Adapter for Vision-Language Pretrained Models☆20Updated last year
- ☆228Updated last year