hananshafi / vits-for-small-scale-datasets
[BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"
☆149Updated last year
Alternatives and similar repositories for vits-for-small-scale-datasets:
Users that are interested in vits-for-small-scale-datasets are comparing it to the libraries listed below
- Implementation of Visual Transformer for Small-size Datasets☆119Updated 3 years ago
- [NeurIPS 2021] Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆141Updated 2 months ago
- Transformers trained on Tiny ImageNet☆53Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆106Updated last year
- [ICLR 2023] This repository includes the official implementation our paper "Can CNNs Be More Robust Than Transformers?"☆143Updated 2 years ago
- [NeurIPS 2022] Implementation of "AdaptFormer: Adapting Vision Transformers for Scalable Visual Recognition"☆346Updated 2 years ago
- iFormer: Inception Transformer☆244Updated 2 years ago
- Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)☆153Updated 2 years ago
- ☆58Updated 2 years ago
- [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"☆104Updated last year
- [ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers…☆266Updated last year
- Code for You Only Cut Once: Boosting Data Augmentation with a Single Cut, ICML 2022.☆104Updated last year
- Parameter Efficient Fine-tuning of Self-supervised ViTs without Catastrophic Forgetting☆23Updated 9 months ago
- An official code release of the paper RGB no more: Minimally Decoded JPEG Vision Transformers☆56Updated last year
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆124Updated 2 weeks ago
- Simple CIFAR-10 classification with ConvMixer☆43Updated 3 years ago
- Compare neural networks by their feature similarity☆354Updated last year
- MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning☆139Updated last year
- Fine-tuning Vision Transformers on various classification datasets☆106Updated 6 months ago
- The official implementation of CMAE https://arxiv.org/abs/2207.13532 and https://ieeexplore.ieee.org/document/10330745☆95Updated last year
- Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.☆73Updated 4 years ago
- [CVPR 2022] This repository includes the official project for the paper: TransMix: Attend to Mix for Vision Transformers.☆155Updated 2 years ago
- This is the official implementation of TrivialAugment and a mini-library for the application of multiple image augmentation strategies in…☆156Updated 2 years ago
- The official code of Relevance-CAM☆41Updated last year
- [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.☆174Updated 2 years ago
- This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"☆195Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆140Updated 2 years ago
- Official Implementation of TeachAugment: Data Augmentation Optimization Using Teacher Knowledge (CVPR2022, Oral)☆68Updated 2 years ago