ra1ph2 / Vision-Transformer
Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and CIFAR100.
☆107Updated 10 months ago
Alternatives and similar repositories for Vision-Transformer:
Users that are interested in Vision-Transformer are comparing it to the libraries listed below
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆181Updated last year
- Let's train vision transformers (ViT) for cifar 10!☆592Updated 3 weeks ago
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆170Updated 3 years ago
- PyTorch implementation of Masked Autoencoder☆243Updated last year
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆297Updated 4 years ago
- Tiny-ImageNet Classifier using Pytorch☆88Updated 6 years ago
- An Numpy and PyTorch Implementation of CKA-similarity with CUDA support☆89Updated 3 years ago
- pytorch-tiny-imagenet☆170Updated last year
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆147Updated last year
- Transformers trained on Tiny ImageNet☆52Updated 2 years ago
- A pytorch implementation of interpretable convolutional neural network.☆65Updated 3 years ago
- Compare neural networks by their feature similarity☆352Updated last year
- Pytorch ViT for Image classification on the CIFAR10 dataset☆34Updated 3 years ago
- Vision Transformer Pruning☆55Updated 3 years ago
- ☆125Updated 4 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- Library - Vanilla, ViT, DeiT, BERT, GPT☆64Updated 3 years ago
- ☆56Updated 4 years ago
- A simple implementation of Batch Normalization using pytorch.☆44Updated 4 years ago
- Recent Advances on Efficient Vision Transformers☆49Updated 2 years ago
- Implementation of Visual Transformer for Small-size Datasets☆119Updated 2 years ago
- Pytorch implementation of various neural network interpretability methods☆115Updated 2 years ago
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆74Updated 2 months ago
- The official code for our TIP paper 'LayerCAM: Exploring Hierarchical Class Activation Maps for Localization'☆121Updated 2 years ago
- AutoEncoder trained on ImageNet☆99Updated 2 years ago
- Image classification on Tiny ImageNet☆73Updated last year
- A PyTorch implementation of VGG16. This could be considered as a variant of the original VGG16 since BN layers are added after each conv…☆184Updated 5 years ago
- Pytorch implementation of some vision transformers, trained on CIFAR-10.☆29Updated 3 years ago
- Pretrained models on CIFAR10/100 in PyTorch☆336Updated last year
- ☆231Updated 3 years ago