lucidrains / bidirectional-cross-attentionLinks
A simple cross attention that updates both the source and target in one step
☆176Updated 3 weeks ago
Alternatives and similar repositories for bidirectional-cross-attention
Users that are interested in bidirectional-cross-attention are comparing it to the libraries listed below
Sorting:
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆55Updated 10 months ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆70Updated last year
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆263Updated last year
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆204Updated 4 years ago
- Simple MAE (masked autoencoders) with pytorch and pytorch-lightning.☆44Updated last year
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆183Updated 3 months ago
- ☆161Updated 2 months ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆181Updated 2 years ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆102Updated this week
- [CVPR'23 & TPAMI'25] Hard Patches Mining for Masked Image Modeling & Bootstrap Masked Visual Modeling via Hard Patch Mining☆101Updated 4 months ago
- An implementation of the efficient attention module.☆320Updated 4 years ago
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆63Updated last year
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated 6 months ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆116Updated 2 years ago
- Transformers w/o Attention, based fully on MLPs☆94Updated last year
- Official PyTorch implementation for the paper "CARD: Classification and Regression Diffusion Models"☆230Updated 2 years ago
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 7 months ago
- [NeurIPS 2023, Spotlight] Rank-N-Contrast: Learning Continuous Representations for Regression☆115Updated last year
- Implementation of Linformer for Pytorch☆295Updated last year
- An implementation of local windowed attention for language modeling☆472Updated last month
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆218Updated 4 years ago
- MultiMAE: Multi-modal Multi-task Masked Autoencoders, ECCV 2022☆591Updated 2 years ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆111Updated last year
- The code of "Improving Deep Regression with Ordinal Entropy" in ICLR 2023☆51Updated last year
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆305Updated 3 years ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆138Updated 5 months ago
- Official implementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".☆34Updated 2 years ago
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆117Updated 4 months ago
- [TMLR 2022] High-Modality Multimodal Transformer☆117Updated 9 months ago