ra1ph2 / Vision-Transformer
Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and CIFAR100.
☆103Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for Vision-Transformer
- Implementation of Visual Transformer for Small-size Datasets☆117Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆209Updated 3 years ago
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆141Updated last year
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆170Updated 9 months ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆112Updated last year
- A complete easy to follow implementation of Google's Vision Transformer proposed in "AN IMAGE IS WORTH 16X16 WORDS". This pytorch impleme…☆94Updated 3 years ago
- Library - Vanilla, ViT, DeiT, BERT, GPT☆63Updated 3 years ago
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆289Updated 4 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆140Updated 3 years ago
- Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.☆68Updated 3 years ago
- PyTorch implementation of Masked Autoencoder☆232Updated last year
- Compare neural networks by their feature similarity☆343Updated last year
- Let's train vision transformers (ViT) for cifar 10!☆539Updated last month
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆158Updated 2 years ago
- An Numpy and PyTorch Implementation of CKA-similarity with CUDA support☆82Updated 3 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆124Updated 4 years ago
- Pytorch SimCLR on CIFAR10 (92.85% test accuracy)☆56Updated 4 years ago
- A PyTorch implementation of MoCo based on CVPR 2020 paper "Momentum Contrast for Unsupervised Visual Representation Learning"☆47Updated 4 years ago
- NeurIPS 2021, Official codes for "Efficient Training of Visual Transformers with Small Datasets".☆139Updated last year
- ☆220Updated 3 years ago
- Pretrained models on CIFAR10/100 in PyTorch☆313Updated last year
- ☆65Updated 3 years ago
- Vision Transformer (ViT) in PyTorch☆794Updated 2 years ago
- Transformers trained on Tiny ImageNet☆47Updated 2 years ago
- [NeurIPS 2021] [T-PAMI] Global Filter Networks for Image Classification☆445Updated last year
- Recent Advances on Efficient Vision Transformers☆47Updated last year
- ResMLP: Feedforward networks for image classification with data-efficient training☆39Updated 3 years ago
- ☆52Updated 4 years ago
- PyTorch implementation of SimCLR: supports multi-GPU training and closely reproduces results☆192Updated 6 months ago
- Tiny-ImageNet Classifier using Pytorch☆84Updated 6 years ago