pliang279 / HighMMT
[TMLR 2022] High-Modality Multimodal Transformer
☆114Updated 5 months ago
Alternatives and similar repositories for HighMMT:
Users that are interested in HighMMT are comparing it to the libraries listed below
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆67Updated last year
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated last month
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆96Updated 7 months ago
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 2 months ago
- Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval". CVPR 2022☆102Updated 2 years ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆71Updated 5 months ago
- ☆117Updated 2 years ago
- Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning☆150Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks☆28Updated 2 years ago
- ☆64Updated 3 years ago
- ☆54Updated 2 years ago
- The Continual Learning in Multimodality Benchmark☆66Updated last year
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆33Updated last year
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆83Updated 3 years ago
- ☆73Updated 2 years ago
- ☆22Updated 2 years ago
- ☆26Updated 3 years ago
- PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)☆204Updated 2 years ago
- Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"☆139Updated 2 years ago
- Sapsucker Woods 60 Audiovisual Dataset☆15Updated 2 years ago
- ☆42Updated last year
- [ICLR 2019] Learning Factorized Multimodal Representations☆67Updated 4 years ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆86Updated 3 years ago
- CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021☆62Updated 3 years ago
- PyTorch code for “TVLT: Textless Vision-Language Transformer” (NeurIPS 2022 Oral)☆124Updated 2 years ago
- Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers☆90Updated last year
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆81Updated 11 months ago
- We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…☆47Updated 3 years ago
- NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)☆48Updated last year