fac2003 / perceiver-multi-modality-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
☆37Updated 3 years ago
Alternatives and similar repositories for perceiver-multi-modality-pytorch:
Users that are interested in perceiver-multi-modality-pytorch are comparing it to the libraries listed below
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆129Updated last year
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆133Updated 4 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 4 years ago
- A Domain-Agnostic Benchmark for Self-Supervised Learning☆107Updated last year
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- A simple cross attention that updates both the source and target in one step☆164Updated 10 months ago
- ☆164Updated 2 years ago
- ☆47Updated 2 years ago
- A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training☆455Updated last year
- Axial Positional Embedding for Pytorch☆76Updated last month
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆206Updated last year
- An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up proc…☆193Updated 4 years ago
- Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification☆131Updated 3 years ago
- ☆157Updated 2 years ago
- Implementation of Slot Attention from GoogleAI☆417Updated 7 months ago
- [TMLR 2022] High-Modality Multimodal Transformer☆113Updated 4 months ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆99Updated 2 years ago
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆86Updated 3 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆126Updated 2 years ago
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆115Updated 4 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆118Updated 3 years ago
- VICRegL official code base☆226Updated 2 years ago
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆251Updated 2 years ago
- Experiment with diffusion models that you can run on your local jupyter instances☆57Updated 5 months ago
- Unofficial Implementation of "Denoising Diffusion Probabilistic Models" in PyTorch(Lightning)☆89Updated 4 years ago
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆204Updated last year
- Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch☆86Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆87Updated last year