fac2003 / perceiver-multi-modality-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
☆37Updated 3 years ago
Alternatives and similar repositories for perceiver-multi-modality-pytorch:
Users that are interested in perceiver-multi-modality-pytorch are comparing it to the libraries listed below
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆127Updated last year
- A Domain-Agnostic Benchmark for Self-Supervised Learning☆107Updated last year
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆204Updated last year
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆96Updated last year
- ☆63Updated 2 years ago
- ☆163Updated 2 years ago
- A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training☆452Updated last year
- ☆47Updated 2 years ago
- Implementation of Slot Attention from GoogleAI☆410Updated 6 months ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆129Updated 3 years ago
- Implementation of Feedback Transformer in Pytorch☆105Updated 3 years ago
- A Pytorch implementation of the optimal transport kernel embedding☆114Updated 4 years ago
- GPT, but made only out of MLPs☆88Updated 3 years ago
- A simple cross attention that updates both the source and target in one step☆162Updated 9 months ago
- An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up proc…☆193Updated 3 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆118Updated 3 years ago
- Exemplar VAE: Linking Generative Models, Nearest Neighbor Retrieval, and Data Augmentation☆69Updated 4 years ago
- VICRegL official code base☆223Updated last year
- ☆156Updated 2 years ago
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆87Updated last year
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆204Updated last year
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆98Updated 2 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- [CVPR 2023] Learning Visual Representations via Language-Guided Sampling☆146Updated last year
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- EsViT: Efficient self-supervised Vision Transformers☆411Updated last year
- Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch☆251Updated 2 years ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆101Updated 10 months ago
- ☆231Updated 3 years ago