wzlxjtu / PositionalEncoding2D
A PyTorch implementation of the 1d and 2d Sinusoidal positional encoding/embedding.
☆252Updated 4 years ago
Alternatives and similar repositories for PositionalEncoding2D:
Users that are interested in PositionalEncoding2D are comparing it to the libraries listed below
- An implementation of 1D, 2D, and 3D positional encoding in Pytorch and TensorFlow☆566Updated 3 months ago
- Implementation of Slot Attention from GoogleAI☆410Updated 6 months ago
- Learning Rate Warmup in PyTorch☆403Updated 2 weeks ago
- Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…☆305Updated 3 years ago
- Tiny PyTorch library for maintaining a moving average of a collection of parameters.☆421Updated 4 months ago
- Source code for "On the Relationship between Self-Attention and Convolutional Layers"☆1,096Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆217Updated 3 years ago
- Is the attention layer even necessary? (https://arxiv.org/abs/2105.02723)☆483Updated 3 years ago
- Implementing Stand-Alone Self-Attention in Vision Models using Pytorch☆455Updated 5 years ago
- Implementation of ConvMixer for "Patches Are All You Need? 🤷"☆1,064Updated 2 years ago
- Implementation of Axial attention - attending to multi-dimensional data efficiently☆371Updated 3 years ago
- An implementation of the efficient attention module.☆301Updated 4 years ago
- An All-MLP solution for Vision, from Google AI☆1,014Updated 5 months ago
- Self-supervised vIsion Transformer (SiT)☆326Updated 2 years ago
- Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch☆1,120Updated last year
- Pytorch implementation of "An intriguing failing of convolutional neural networks and the CoordConv solution" - https://arxiv.org/abs/180…☆151Updated last year
- My take on a practical implementation of Linformer for Pytorch.☆412Updated 2 years ago
- Transformer based on a variant of attention that is linear complexity in respect to sequence length☆738Updated 9 months ago
- Implementation of Linformer for Pytorch☆266Updated last year
- ☆450Updated last year
- Sinkhorn Transformer - Practical implementation of Sparse Sinkhorn Attention☆257Updated 3 years ago
- PyTorch implementation of Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning☆483Updated 2 years ago
- Approximating Wasserstein distances with PyTorch☆457Updated last year
- Gradually-Warmup Learning Rate Scheduler for PyTorch☆986Updated 4 months ago
- Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch☆257Updated 4 years ago
- PyTorch Implementation of CvT: Introducing Convolutions to Vision Transformers☆227Updated 3 years ago
- An implementation of Performer, a linear attention-based transformer, in Pytorch☆1,114Updated 3 years ago
- Dense Contrastive Learning (DenseCL) for self-supervised representation learning, CVPR 2021 Oral.☆555Updated last year
- Fully featured implementation of Routing Transformer☆288Updated 3 years ago
- This is a PyTorch re-implementation of Axial-DeepLab (ECCV 2020 Spotlight)☆451Updated 3 years ago