lucidrains / bidirectional-cross-attentionLinks
A simple cross attention that updates both the source and target in one step
☆192Updated 5 months ago
Alternatives and similar repositories for bidirectional-cross-attention
Users that are interested in bidirectional-cross-attention are comparing it to the libraries listed below
Sorting:
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆98Updated 2 years ago
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆55Updated last year
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆74Updated 2 years ago
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆209Updated 4 years ago
- [NeurIPS 2023, Spotlight] Rank-N-Contrast: Learning Continuous Representations for Regression☆132Updated last year
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆273Updated last year
- Official PyTorch implementation for the paper "CARD: Classification and Regression Diffusion Models"☆234Updated 2 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆184Updated 2 years ago
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆183Updated 8 months ago
- Ofiicial Implementation for Mamba-ND: Selective State Space Modeling for Multi-Dimensional Data☆65Updated last year
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆125Updated 4 months ago
- An implementation of the efficient attention module.☆327Updated 5 years ago
- An implementation of local windowed attention for language modeling☆492Updated 5 months ago
- Transformers w/o Attention, based fully on MLPs☆97Updated last year
- PyTorch implementation of Representation Learning with Contrastive Predictive Coding by Van den Oord et al. (2018)☆89Updated 4 years ago
- [TMLR 2022] High-Modality Multimodal Transformer☆117Updated last year
- Implementation of Linformer for Pytorch☆303Updated 2 years ago
- State Space Models☆71Updated last year
- Official Implementation of "Geometric Multimodal Contrastive Representation Learning" (https://arxiv.org/abs/2202.03390)☆28Updated last year
- The code of "Improving Deep Regression with Ordinal Entropy" in ICLR 2023☆54Updated 2 years ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆114Updated last year
- ☆163Updated 6 months ago
- Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders☆129Updated 9 months ago
- Simba☆215Updated last year
- Official PyTorch Implementation of "The Hidden Attention of Mamba Models"☆232Updated 2 months ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆102Updated 3 years ago
- An efficient pytorch implementation of selective scan in one file, works with both cpu and gpu, with corresponding mathematical derivatio…☆101Updated 3 months ago
- Official implementation of "Hydra: Bidirectional State Space Models Through Generalized Matrix Mixers"☆170Updated 11 months ago
- Official Open Source code for "Masked Autoencoders As Spatiotemporal Learners"☆360Updated last month
- VICRegL official code base☆231Updated 2 years ago