pliang279 / HighMMT
[TMLR 2022] High-Modality Multimodal Transformer
☆114Updated 5 months ago
Alternatives and similar repositories for HighMMT:
Users that are interested in HighMMT are comparing it to the libraries listed below
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆66Updated last year
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆96Updated 8 months ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated last month
- The Continual Learning in Multimodality Benchmark☆67Updated last year
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆72Updated 5 months ago
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆33Updated last year
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 3 months ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆153Updated 2 years ago
- CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021☆63Updated 3 years ago
- ☆72Updated 2 years ago
- ☆117Updated 2 years ago
- ☆26Updated 3 years ago
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆252Updated 8 months ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆87Updated 3 years ago
- Language Quantized AutoEncoders☆103Updated 2 years ago
- [ICLR 2019] Learning Factorized Multimodal Representations☆67Updated 4 years ago
- [NeurIPS 2023] Bootstrapping Vision-Language Learning with Decoupled Language Pre-training☆24Updated last year
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆83Updated 3 years ago
- A PyTorch implementation of Multimodal Few-Shot Learning with Frozen Language Models with OPT.☆44Updated 2 years ago
- ☆81Updated 8 months ago
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)☆48Updated last year
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆73Updated last year
- [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift☆36Updated last year
- Code Example for Learning Multimodal Data Augmentation in Feature Space☆42Updated 2 years ago
- Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval." CVPR 2022☆105Updated 2 years ago
- ☆22Updated 2 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆51Updated 3 years ago
- Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)☆18Updated last year
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆205Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year