sunsmarterjie / beyond_masking
Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers
☆26Updated 3 years ago
Alternatives and similar repositories for beyond_masking:
Users that are interested in beyond_masking are comparing it to the libraries listed below
- Bag of Instances Aggregation Boosts Self-supervised Distillation (ICLR 2022)☆33Updated 3 years ago
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆28Updated 2 years ago
- ☆16Updated last year
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆55Updated last year
- code base for vision transformers☆36Updated 3 years ago
- Official Codes and Pretrained Models for RecursiveMix☆22Updated 2 years ago
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 3 years ago
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Updated 2 months ago
- Official code for the paper, "TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter".☆16Updated last year
- [ECCV2022] The PyTorch implementation of paper "Equivariance and Invariance Inductive Bias for Learning from Insufficient Data"☆19Updated 2 years ago
- 📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)☆52Updated last year
- [ICCV 23]This is a Pytorch implementation of our paper "SMMix: Self-Motivated Image Mixing for Vision Transformers"☆16Updated last year
- Teach-DETR: Better Training DETR with Teachers☆31Updated last year
- ☆36Updated 3 years ago
- SOIT: Segmenting Objects with Instance-Aware Transformers☆14Updated 2 years ago
- Code and models for the paper Glance-and-Gaze Vision Transformer☆28Updated 3 years ago
- [ICLR 2022]: Fast AdvProp☆35Updated 3 years ago
- ☆52Updated 2 years ago
- ☆59Updated 3 years ago
- ISD: Self-Supervised Learning by Iterative Similarity Distillation☆36Updated 3 years ago
- ☆19Updated 2 years ago
- FastMIM, official pytorch implementation of our paper "FastMIM: Expediting Masked Image Modeling Pre-training for Vision"(https://arxiv.o…☆39Updated 2 years ago
- Rethinking Nearest Neighbors for Visual Classification☆31Updated 3 years ago
- ☆56Updated this week
- Official Code Release for Container : Context Aggregation Network☆46Updated 3 years ago
- PyTorch implementation of Asymmetric Siamese (https://arxiv.org/abs/2204.00613)☆99Updated 3 years ago
- ☆32Updated 2 years ago
- Benchmarking Attention Mechanism in Vision Transformers.☆17Updated 2 years ago
- Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training☆16Updated 3 months ago
- The Curious Layperson: Fine-Grained Image Recognition without Expert Labels (BMVC 2021 best student paper)☆23Updated 2 years ago