sunsmarterjie / beyond_masking
Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers
☆26Updated 3 years ago
Alternatives and similar repositories for beyond_masking:
Users that are interested in beyond_masking are comparing it to the libraries listed below
- Bag of Instances Aggregation Boosts Self-supervised Distillation (ICLR 2022)☆33Updated 2 years ago
- code base for vision transformers☆36Updated 3 years ago
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 3 years ago
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆53Updated last year
- 📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)☆52Updated last year
- Benchmarking Attention Mechanism in Vision Transformers.☆17Updated 2 years ago
- Rethinking Nearest Neighbors for Visual Classification☆31Updated 3 years ago
- ☆59Updated 3 years ago
- ☆16Updated last year
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Updated last month
- Official code for the paper, "TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter".☆16Updated last year
- ☆56Updated 2 years ago
- Official codes for ConMIM (ICLR 2023)☆58Updated 2 years ago
- Official Codes and Pretrained Models for RecursiveMix☆22Updated last year
- ☆32Updated 2 years ago
- [ICCV 23]This is a Pytorch implementation of our paper "SMMix: Self-Motivated Image Mixing for Vision Transformers"☆16Updated last year
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆28Updated 2 years ago
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- [ICLR 2022]: Fast AdvProp☆35Updated 3 years ago
- ☆57Updated 3 years ago
- [ECCV2022] The PyTorch implementation of paper "Equivariance and Invariance Inductive Bias for Learning from Insufficient Data"☆19Updated 2 years ago
- Code and models for the paper Glance-and-Gaze Vision Transformer☆28Updated 3 years ago
- Teach-DETR: Better Training DETR with Teachers☆31Updated last year
- This is the official code repo for "RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning?"☆37Updated 3 years ago
- ☆23Updated 2 years ago
- The Curious Layperson: Fine-Grained Image Recognition without Expert Labels (BMVC 2021 best student paper)☆23Updated 2 years ago
- ☆19Updated 2 years ago
- ☆18Updated 2 years ago
- PyTorch implementation of the paper "MILAN: Masked Image Pretraining on Language Assisted Representation" https://arxiv.org/pdf/2208.0604…☆82Updated 2 years ago
- PyTorch implementation of Asymmetric Siamese (https://arxiv.org/abs/2204.00613)☆99Updated 2 years ago