lucidrains / bidirectional-cross-attentionLinks
A simple cross attention that updates both the source and target in one step
☆172Updated last year
Alternatives and similar repositories for bidirectional-cross-attention
Users that are interested in bidirectional-cross-attention are comparing it to the libraries listed below
Sorting:
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆51Updated 9 months ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆203Updated 4 years ago
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆184Updated 2 months ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆69Updated last year
- ☆160Updated last month
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆261Updated 11 months ago
- [NeurIPS 2023, Spotlight] Rank-N-Contrast: Learning Continuous Representations for Regression☆114Updated last year
- An implementation of the efficient attention module.☆319Updated 4 years ago
- Transformers w/o Attention, based fully on MLPs☆93Updated last year
- Implementation of Linformer for Pytorch☆290Updated last year
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆61Updated last year
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆218Updated 4 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆115Updated 2 years ago
- Official repository for "Orthogonal Projection Loss" (ICCV'21)☆125Updated 3 years ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆99Updated last year
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆101Updated 3 years ago
- An implementation of local windowed attention for language modeling☆460Updated 6 months ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated 4 months ago
- [CVPR'23 & TPAMI'25] Hard Patches Mining for Masked Image Modeling☆97Updated 3 months ago
- Official PyTorch implementation for the paper "CARD: Classification and Regression Diffusion Models"☆228Updated 2 years ago
- VICRegL official code base☆228Updated 2 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆180Updated 2 years ago
- Simple MAE (masked autoencoders) with pytorch and pytorch-lightning.☆43Updated last year
- [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention☆194Updated 2 years ago
- [ICLR 2023] "Dilated convolution with learnable spacings" Ismail Khalfaoui Hassani, Thomas Pellegrini and Timothée Masquelier☆68Updated last year
- [TMLR 2022] High-Modality Multimodal Transformer☆116Updated 8 months ago
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆135Updated 3 months ago
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆58Updated last year
- Code repository for the ICLR 2022 paper "FlexConv: Continuous Kernel Convolutions With Differentiable Kernel Sizes" https://openreview.ne…☆116Updated 2 years ago