Jack-Etheredge / early_convolutions_vit_pytorch
(Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better
☆43Updated 3 years ago
Alternatives and similar repositories for early_convolutions_vit_pytorch:
Users that are interested in early_convolutions_vit_pytorch are comparing it to the libraries listed below
- [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention☆116Updated 2 years ago
- LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)☆63Updated last week
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆80Updated last year
- [ICLR 2022]: Fast AdvProp☆35Updated 3 years ago
- The implementation of our paper: Towards Robust Vision Transformer (CVPR2022)☆142Updated 2 years ago
- This is a offical PyTorch/GPU implementation of SupMAE.☆77Updated 2 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- ☆57Updated 2 years ago
- Official pytorch implementation for CVPR2022 paper "Bootstrapping ViTs: Towards Liberating Vision Transformers from Pre-training"☆17Updated 3 years ago
- ☆119Updated 3 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- PyTorch Implementation of "Your ViT is Secretly a Hybrid Discriminative-Generative Diffusion Model"☆48Updated 2 years ago
- [ICME 2022] code for the paper, SimVit: Exploring a simple vision transformer with sliding windows.☆68Updated 2 years ago
- ☆24Updated 3 years ago
- Official codes: Self-Supervised Learning by Estimating Twin Class Distribution☆100Updated 3 years ago
- Code for You Only Cut Once: Boosting Data Augmentation with a Single Cut, ICML 2022.☆104Updated last year
- Implementation of HAT https://arxiv.org/pdf/2204.00993☆49Updated last year
- Official Pytorch implementation of Super Vision Transformer (IJCV)☆43Updated last year
- Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.☆37Updated 2 years ago
- ☆84Updated 3 years ago
- This is an unofficial implementation of BOAT: Bilateral Local Attention Vision Transformer☆54Updated 3 years ago
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆141Updated 3 months ago
- This is the official GitHub for paper: On the Versatile Uses of Partial Distance Correlation in Deep Learning, in ECCV 2022☆173Updated last year
- Beyond Masking: Demystifying Token-Based Pre-Training for Vision Transformers☆26Updated 3 years ago
- TokenMix: Rethinking Image Mixing for Data Augmentation in Vision Transformers (ECCV 2022)☆93Updated 2 years ago
- Official PyTorch implementation of Fast-MoCo☆16Updated 2 years ago
- [ICLR'22] This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".☆126Updated 2 years ago
- [ICLR2024] Exploring Target Representations for Masked Autoencoders☆53Updated last year
- Official Codes and Pretrained Models for RecursiveMix☆22Updated last year
- open source the research work for published on arxiv. https://arxiv.org/abs/2106.02689☆51Updated 3 years ago