fac2003 / perceiver-multi-modality-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
☆37Updated 3 years ago
Alternatives and similar repositories for perceiver-multi-modality-pytorch:
Users that are interested in perceiver-multi-modality-pytorch are comparing it to the libraries listed below
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆131Updated last month
- A Domain-Agnostic Benchmark for Self-Supervised Learning☆107Updated last year
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆97Updated last year
- VICRegL official code base☆226Updated 2 years ago
- An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up proc…☆193Updated 4 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆135Updated 4 years ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 3 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆207Updated last year
- ☆63Updated 2 years ago
- ☆164Updated 2 years ago
- [TMLR 2022] High-Modality Multimodal Transformer☆114Updated 5 months ago
- An active learning library for Pytorch based on Lightning-Fabric.☆79Updated 11 months ago
- A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training☆462Updated last year
- Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena☆203Updated last year
- Implementation of Feedback Transformer in Pytorch☆105Updated 4 years ago
- A Pytorch implementation of the optimal transport kernel embedding☆116Updated 4 years ago
- A simple cross attention that updates both the source and target in one step☆169Updated 11 months ago
- EsViT: Efficient self-supervised Vision Transformers☆410Updated last year
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆103Updated last month
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆87Updated 3 years ago
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆99Updated 3 years ago
- TF/Keras code for DiffStride, a pooling layer with learnable strides.☆124Updated 3 years ago
- A PyTorch implementation of the Exclusive Cross Entropy Loss.☆20Updated 2 years ago
- Implementation of Dat2Vec2.0 for vision☆18Updated 2 years ago
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆118Updated 3 years ago
- ☆47Updated 2 years ago
- PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI☆177Updated last year
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆99Updated 2 years ago
- Code to train the SimSiam model on cifar10 using PyTorch☆40Updated 3 years ago