sunsmarterjie / beyond_masking
Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers
☆26Updated 2 years ago
Alternatives and similar repositories for beyond_masking:
Users that are interested in beyond_masking are comparing it to the libraries listed below
- Bag of Instances Aggregation Boosts Self-supervised Distillation (ICLR 2022)☆33Updated 2 years ago
- [CVPR 2022] "The Principle of Diversity: Training Stronger Vision Transformers Calls for Reducing All Levels of Redundancy" by Tianlong C…☆25Updated 2 years ago
- Official code for "Dynamic Token Normalization Improves Vision Transformer", ICLR 2022.☆28Updated 2 years ago
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆52Updated last year
- [ICLR 2022]: Fast AdvProp☆34Updated 2 years ago
- Official code for the paper, "TaCA: Upgrading Your Visual Foundation Model with Task-agnostic Compatible Adapter".☆16Updated last year
- Code and models for the paper Glance-and-Gaze Vision Transformer☆28Updated 3 years ago
- Official codes for ConMIM (ICLR 2023)☆58Updated last year
- ☆56Updated 3 years ago
- ☆56Updated 2 years ago
- [TMLR'24] This repository includes the official implementation our paper "Unleashing the Power of Visual Prompting At the Pixel Level"☆37Updated 9 months ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- ISD: Self-Supervised Learning by Iterative Similarity Distillation☆36Updated 3 years ago
- Contrastive Object-level Pre-training with Spatial Noise Curriculum Learning☆20Updated 2 years ago
- ☆59Updated 2 years ago
- [ICCV 23]This is a Pytorch implementation of our paper "SMMix: Self-Motivated Image Mixing for Vision Transformers"☆16Updated last year
- Official Pytorch Implementation of: "Semantic Diversity Learning for Zero-Shot Multi-label Classification"(ICCV, 2021) paper☆30Updated 2 years ago
- [ECCV2022] The PyTorch implementation of paper "Equivariance and Invariance Inductive Bias for Learning from Insufficient Data"☆18Updated 2 years ago
- ☆18Updated 2 years ago
- (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers☆25Updated 2 years ago
- ☆16Updated last year
- ☆19Updated 2 years ago
- code base for vision transformers☆36Updated 3 years ago
- Paper List for In-context Learning 🌷☆20Updated 2 years ago
- [ECCV 2022] Official pytorch implementation of "mc-BEiT: Multi-choice Discretization for Image BERT Pre-training" in European Conference …☆22Updated 2 years ago
- [CVPR2022] PyTorch re-implementation of Prompt Distribution Learning☆17Updated last year
- Compress conventional Vision-Language Pre-training data☆49Updated last year
- This is the official code repo for "RegionCL: Can Simple Region Swapping Contribute to Contrastive Learning?"☆37Updated 3 years ago
- Benchmarking Attention Mechanism in Vision Transformers.☆17Updated 2 years ago
- ReSSL: Relational Self-Supervised Learning with Weak Augmentation☆57Updated 3 years ago