lucidrains / bidirectional-cross-attention
A simple cross attention that updates both the source and target in one step
☆162Updated 9 months ago
Alternatives and similar repositories for bidirectional-cross-attention:
Users that are interested in bidirectional-cross-attention are comparing it to the libraries listed below
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆96Updated last year
- Implementation of CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classification☆193Updated 3 years ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆101Updated 10 months ago
- MultiMAE: Multi-modal Multi-task Masked Autoencoders, ECCV 2022☆562Updated 2 years ago
- [NeurIPS 2023] Factorized Contrastive Learning: Going Beyond Multi-view Redundancy☆64Updated last year
- Transformers w/o Attention, based fully on MLPs☆93Updated 10 months ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆105Updated 11 months ago
- Implementation of Linformer for Pytorch☆266Updated last year
- An implementation of local windowed attention for language modeling☆420Updated last month
- [T-PAMI] A curated list of self-supervised multimodal learning resources.☆243Updated 6 months ago
- Official PyTorch implementation for the paper "CARD: Classification and Regression Diffusion Models"☆221Updated last year
- Learnable Fourier Features for Multi-Dimensional Spatial Positional Encoding☆45Updated 4 months ago
- Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"☆317Updated 2 weeks ago
- Code repository of the paper "Modelling Long Range Dependencies in ND: From Task-Specific to a General Purpose CNN" https://arxiv.org/abs…☆183Updated last year
- [NeurIPS 2023, Spotlight] Rank-N-Contrast: Learning Continuous Representations for Regression☆103Updated 11 months ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆98Updated 2 years ago
- A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch☆85Updated last year
- Recent Advances in MLP-based Models (MLP is all you need!)☆113Updated 2 years ago
- Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch☆341Updated last year
- [ICLR 2022] Official implementation of cosformer-attention in cosFormer: Rethinking Softmax in Attention☆185Updated 2 years ago
- This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"☆100Updated last year
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆305Updated 3 years ago
- ☆154Updated 2 years ago
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆559Updated 2 months ago
- ☆212Updated last year
- Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023☆150Updated last year
- Implementation of Slot Attention from GoogleAI☆410Updated 6 months ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆176Updated last year
- The official implementation of CMAE https://arxiv.org/abs/2207.13532 and https://ieeexplore.ieee.org/document/10330745☆93Updated last year
- Official Open Source code for "Masked Autoencoders As Spatiotemporal Learners"☆327Updated 2 months ago