Jack-Etheredge / early_convolutions_vit_pytorch
(Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better
☆43Updated 3 years ago
Alternatives and similar repositories for early_convolutions_vit_pytorch:
Users that are interested in early_convolutions_vit_pytorch are comparing it to the libraries listed below
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆79Updated last year
- ☆119Updated 2 years ago
- LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)☆62Updated 2 years ago
- ☆58Updated 2 years ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention☆115Updated 2 years ago
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆140Updated last month
- [ICLR 2022]: Fast AdvProp☆34Updated 2 years ago
- [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"☆94Updated 2 years ago
- The implementation of our paper: Towards Robust Vision Transformer (CVPR2022)☆140Updated 2 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.☆34Updated 2 years ago
- Implementation of HAT https://arxiv.org/pdf/2204.00993☆48Updated 10 months ago
- Denoising Masked Autoencoders Help Robust Classification.☆60Updated last year
- Unified Architecture Search with Convolution, Transformer, and MLP (ECCV 2022)☆53Updated 2 years ago
- The official repo of the CVPR2021 oral paper: Representative Batch Normalization with Feature Calibration☆86Updated 2 years ago
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆51Updated 3 years ago
- ☆19Updated 2 years ago
- ☆24Updated 3 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆98Updated 3 years ago
- Unofficial PyTorch implementation of the paper "Generating images with sparse representations"☆36Updated 3 years ago
- Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer☆71Updated 2 years ago
- ☆84Updated 2 years ago
- Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers☆26Updated 2 years ago
- Code for You Only Cut Once: Boosting Data Augmentation with a Single Cut, ICML 2022.☆104Updated last year
- ☆74Updated 4 years ago
- PyTorch implementation of MLP-Mixer☆36Updated 3 years ago
- [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.☆67Updated 2 years ago
- A Close Look at Spatial Modeling: From Attention to Convolution☆91Updated 2 years ago
- PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"☆48Updated 2 years ago