lucidrains / bidirectional-cross-attentionLinks
A simple cross attention that updates both the source and target in one step
☆189Updated 4 months ago
Alternatives and similar repositories for bidirectional-cross-attention
Users that are interested in bidirectional-cross-attention are comparing it to the libraries listed below
Sorting:
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆74Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated 2 years ago
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆206Updated 4 years ago
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆55Updated last year
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆271Updated last year
- [NeurIPS 2023, Spotlight] Rank-N-Contrast: Learning Continuous Representations for Regression☆129Updated last year
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆120Updated 3 months ago
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆183Updated 6 months ago
- An implementation of the efficient attention module.☆326Updated 5 years ago
- Simple MAE (masked autoencoders) with pytorch and pytorch-lightning.☆44Updated last year
- ☆162Updated 5 months ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆113Updated last year
- Official PyTorch implementation for the paper "CARD: Classification and Regression Diffusion Models"☆232Updated 2 years ago
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated 11 months ago
- Transformers w/o Attention, based fully on MLPs☆95Updated last year
- PyTorch reimplementation of FlexiViT: One Model for All Patch Sizes☆65Updated last year
- [TMLR 2022] High-Modality Multimodal Transformer☆117Updated last year
- PyTorch implementations of KMeans, Soft-KMeans and Constrained-KMeans which can be run on GPU and work on (mini-)batches of data.☆75Updated 3 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆184Updated 2 years ago
- Official implementation of "A simple, efficient and scalable contrastive masked autoencoder for learning visual representations".☆36Updated 2 years ago
- The code of "Improving Deep Regression with Ordinal Entropy" in ICLR 2023☆53Updated 2 years ago
- [CVPR'23 & TPAMI'25] Hard Patches Mining for Masked Image Modeling & Bootstrap Masked Visual Modeling via Hard Patch Mining☆105Updated 7 months ago
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆126Updated 7 months ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆102Updated 3 years ago
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆64Updated last year
- An implementation of local windowed attention for language modeling☆488Updated 4 months ago
- Official Open Source code for "Masked Autoencoders As Spatiotemporal Learners"☆357Updated this week
- The official repo for [TPAMI'23] "Vision Transformer with Quadrangle Attention"☆225Updated 2 months ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated 9 months ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆81Updated last year