pliang279 / HighMMTLinks
[TMLR 2022] High-Modality Multimodal Transformer
☆117Updated 9 months ago
Alternatives and similar repositories for HighMMT
Users that are interested in HighMMT are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆70Updated last year
- [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models☆96Updated 11 months ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆104Updated 5 months ago
- ☆120Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 7 months ago
- ☆22Updated 2 years ago
- ☆65Updated 3 years ago
- ☆28Updated 3 years ago
- A Domain-Agnostic Benchmark for Self-Supervised Learning☆107Updated 2 years ago
- [NeurIPS 2023, ICMI 2023] Quantifying & Modeling Multimodal Interactions☆77Updated 9 months ago
- PyTorch implementation of LIMoE☆53Updated last year
- CVPR 2022, Robust Contrastive Learning against Noisy Views☆83Updated 3 years ago
- Implementation for the paper "Reliable Visual Question Answering Abstain Rather Than Answer Incorrectly" (ECCV 2022: https//arxiv.org/abs…☆35Updated 2 years ago
- ☆81Updated last year
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆149Updated 2 years ago
- Code for the paper Self-Supervised Learning of Split Invariant Equivariant Representations☆28Updated last year
- ☆49Updated 2 years ago
- A curated list of vision-and-language pre-training (VLP). :-)☆59Updated 3 years ago
- A Benchmark for Efficient and Compositional Visual Reasoning☆25Updated 2 years ago
- ☆26Updated 3 years ago
- CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021☆64Updated 3 years ago
- Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks☆29Updated 3 years ago
- Pytorch Implementation for "Preserving Linear Separability in Continual Learning by Backward Feature Projection" (CVPR 2023)☆18Updated 2 years ago
- [ICLR2024] (EvALign-ICL Benchmark) Beyond Task Performance: Evaluating and Reducing the Flaws of Large Multimodal Models with In-Context …☆22Updated last year
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆57Updated 7 months ago
- Language Quantized AutoEncoders☆108Updated 2 years ago
- [DMLR 2024] Benchmarking Robustness of Multimodal Image-Text Models under Distribution Shift☆37Updated last year
- Patching open-vocabulary models by interpolating weights☆91Updated last year
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆174Updated last year