sunsmarterjie / beyond_masking
Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers
☆26Updated 2 years ago
Alternatives and similar repositories for beyond_masking:
Users that are interested in beyond_masking are comparing it to the libraries listed below
- Bag of Instances Aggregation Boosts Self-supervised Distillation (ICLR 2022)☆33Updated 2 years ago
- Official code for the paper, "TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter".☆16Updated last year
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆28Updated 2 years ago
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆53Updated last year
- ☆56Updated 2 years ago
- 📍 Official pytorch implementation of paper "ProtoCLIP: Prototypical Contrastive Language Image Pretraining" (IEEE TNNLS)☆52Updated last year
- [ICCV 23]This is a Pytorch implementation of our paper "SMMix: Self-Motivated Image Mixing for Vision Transformers"☆16Updated last year
- ☆16Updated last year
- code base for vision transformers☆36Updated 3 years ago
- ☆18Updated 2 years ago
- Learning to Mask and Permute Visual Tokens for Vision Transformer Pre-Training☆16Updated last month
- ☆32Updated 2 years ago
- Official codes for ConMIM (ICLR 2023)☆58Updated 2 years ago
- ISD: Self-Supervised Learning by Iterative Similarity Distillation☆36Updated 3 years ago
- [CVPR2022] PyTorch re-implementation of Prompt Distribution Learning☆17Updated last year
- [ICLR 2022]: Fast AdvProp☆34Updated 2 years ago
- ☆57Updated 3 years ago
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Updated 2 weeks ago
- [TMLR'24] This repository includes the official implementation our paper "Unleashing the Power of Visual Prompting At the Pixel Level"☆39Updated 10 months ago
- [ECCV 2022] Official pytorch implementation of "mc-BEiT: Multi-choice Discretization for Image BERT Pre-training" in European Conference …☆22Updated 2 years ago
- Benchmarking Attention Mechanism in Vision Transformers.☆17Updated 2 years ago
- ReSSL: Relational Self-Supervised Learning with Weak Augmentation☆58Updated 3 years ago
- ☆59Updated 3 years ago
- Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning☆20Updated 3 years ago
- [CVPR2022 Oral] The official code for "TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognit…☆18Updated 2 years ago
- Official Pytorch Implementation of: "Semantic Diversity Learning for Zero-Shot Multi-label Classification"(ICCV, 2021) paper☆30Updated 2 years ago
- Paper List for In-context Learning 🌷☆20Updated 2 years ago
- Rethinking Nearest Neighbors for Visual Classification☆31Updated 3 years ago
- ☆36Updated 3 years ago
- Official Codes and Pretrained Models for RecursiveMix☆22Updated last year