FocalNet / Networks-Beyond-Attention
A compilation of network architectures for vision and others without usage of self-attention mechanism
☆77Updated 2 years ago
Alternatives and similar repositories for Networks-Beyond-Attention:
Users that are interested in Networks-Beyond-Attention are comparing it to the libraries listed below
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- Official codes for ConMIM (ICLR 2023)☆58Updated last year
- A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.☆136Updated 3 years ago
- code release of research paper "Exploring Long-Sequence Masked Autoencoders"☆99Updated 2 years ago
- ☆57Updated 2 years ago
- Open-source code for Generic Grouping Network (GGN, CVPR 2022)☆109Updated 2 months ago
- [ICLR 2023 Spotlight] GPViT: A High Resolution Non-Hierarchical Vision Transformer with Group Propagation☆99Updated last year
- [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention☆115Updated 2 years ago
- Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496☆81Updated 6 months ago
- PyTorch implementation of R-MAE https//arxiv.org/abs/2306.05411☆109Updated last year
- [NeurIPS 2021] ORL: Unsupervised Object-Level Representation Learning from Scene Images☆58Updated 3 years ago
- This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".☆119Updated 3 years ago
- PyTorch Implementation of Region Similarity Representation Learning (ReSim)☆87Updated 3 years ago
- This code provides a PyTorch implementation for OTTER (Optimal Transport distillation for Efficient zero-shot Recognition), as described …☆68Updated 3 years ago
- ☆58Updated last year
- [NeurIPS 2022] The official implementation of "Learning to Discover and Detect Objects".☆108Updated last year
- Repository providing a wide range of self-supervised pretrained models for computer vision tasks.☆62Updated 3 years ago
- This is the official released code for our paper, The Emergence of Objectness: Learning Zero-Shot Segmentation from Videos, which has bee…☆52Updated last year
- Implementation of Uniformer, a simple attention and 3d convolutional net that achieved SOTA in a number of video classification tasks, de…☆98Updated 2 years ago
- ☆52Updated last year
- Revisiting Contrastive Methods for Unsupervised Learning of Visual Representations. [NeurIPS 2021]☆88Updated 3 years ago
- A PyTorch implementation of Mugs proposed by our paper "Mugs: A Multi-Granular Self-Supervised Learning Framework".☆83Updated 11 months ago
- Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.☆178Updated 2 years ago
- [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.☆67Updated 2 years ago
- Anytime Dense Prediction with Confidence Adaptivity (ICLR 2022)☆50Updated 5 months ago
- A simple minimal implementation of Reversible Vision Transformers☆119Updated 10 months ago
- ☆49Updated last year
- [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…☆76Updated 2 years ago
- GroupViT: Semantic Segmentation Emerges from Text Supervision☆25Updated 2 years ago
- code base for vision transformers☆36Updated 3 years ago