fac2003 / perceiver-multi-modality-pytorch
Implementation of Perceiver, General Perception with Iterative Attention, in Pytorch
☆37Updated 3 years ago
Related projects: ⓘ
- A Domain-Agnostic Benchmark for Self-Supervised Learning☆107Updated last year
- Implementation of Nyström Self-attention, from the paper Nyströmformer☆120Updated 8 months ago
- The official repository for "Intermediate Layers Matter in Momentum Contrastive Self Supervised Learning" paper.☆40Updated 2 years ago
- Implementation of Zorro, Masked Multimodal Transformer, in Pytorch☆95Updated 11 months ago
- ☆205Updated 3 years ago
- A simple to use pytorch wrapper for contrastive self-supervised learning on any neural network☆119Updated 3 years ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆199Updated last year
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆74Updated 2 years ago
- An attempt at the implementation of Glom, Geoffrey Hinton's new idea that integrates concepts from neural fields, top-down-bottom-up proc…☆190Updated 3 years ago
- A simple cross attention that updates both the source and target in one step☆140Updated 4 months ago
- Implementation of Feedback Transformer in Pytorch☆103Updated 3 years ago
- [TMLR 2022] High-Modality Multimodal Transformer☆104Updated 11 months ago
- Multimodal Masked Autoencoders (M3AE): A JAX/Flax Implementation☆100Updated 5 months ago
- Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch☆94Updated last year
- Implementation of Slot Attention from GoogleAI☆378Updated last month
- Uncertainty-aware representation learning (URL) benchmark☆92Updated 6 months ago
- ☆163Updated last year
- Implementation of Long-Short Transformer, combining local and global inductive biases for attention over long sequences, in Pytorch☆116Updated 3 years ago
- An active learning library for Pytorch based on Lightning-Fabric.☆78Updated 4 months ago
- Implementation of STAM (Space Time Attention Model), a pure and simple attention model that reaches SOTA for video classification☆126Updated 3 years ago
- Unofficial PyTorch implementation of TokenLearner by Google AI☆64Updated last year
- Implementation of Memformer, a Memory-augmented Transformer, in Pytorch☆106Updated 3 years ago
- Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload☆123Updated 2 years ago
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆96Updated 2 years ago
- A Pytorch implementation of the optimal transport kernel embedding☆111Updated 3 years ago
- VICRegL official code base☆223Updated last year
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆50Updated 2 years ago
- A collection of code snippets for my PyTorch Lightning projects☆108Updated 3 years ago
- ☆47Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆87Updated last year