ra1ph2 / Vision-TransformerLinks
Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and CIFAR100.
☆114Updated last year
Alternatives and similar repositories for Vision-Transformer
Users that are interested in Vision-Transformer are comparing it to the libraries listed below
Sorting:
- Implementation of Visual Transformer for Small-size Datasets☆125Updated 3 years ago
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆311Updated 5 years ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆197Updated last year
- PyTorch implementation of Masked Autoencoder☆272Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆218Updated 4 years ago
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆162Updated last year
- A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …☆181Updated 3 years ago
- Compare neural networks by their feature similarity☆374Updated 2 years ago
- pytorch-tiny-imagenet☆184Updated 2 weeks ago
- Library - Vanilla, ViT, DeiT, BERT, GPT☆67Updated 4 years ago
- Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.☆76Updated 4 years ago
- Transformers trained on Tiny ImageNet☆58Updated last month
- ☆72Updated 4 years ago
- Let's train vision transformers (ViT) for cifar 10 / cifar 100!☆675Updated 2 months ago
- The official code of Relevance-CAM☆45Updated last year
- An Numpy and PyTorch Implementation of CKA-similarity with CUDA support☆94Updated 4 years ago
- Pytorch version of Vision Transformer (ViT) with pretrained models. This is part of CASL (https://casl-project.github.io/) and ASYML proj…☆359Updated 4 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆200Updated 2 years ago
- When Does Label Smoothing Help?_pytorch_implementationimp☆126Updated 5 years ago
- A PyTorch implementation of MoCo based on CVPR 2020 paper "Momentum Contrast for Unsupervised Visual Representation Learning"☆55Updated 4 years ago
- ☆253Updated 4 years ago
- Demonstration of transfer of knowledge and generalization with distillation☆55Updated 6 years ago
- A complete easy to follow implementation of Google's Vision Transformer proposed in "AN IMAGE IS WORTH 16X16 WORDS". This pytorch impleme…☆97Updated 4 years ago
- [NeurIPS 2021]: Are Transformers More Robust Than CNNs? (Pytorch implementation & checkpoints)☆179Updated 3 years ago
- Pytorch implementation of various neural network interpretability methods☆118Updated 3 years ago
- Recent Advances in MLP-based Models (MLP is all you need!)☆116Updated 2 years ago
- This is an official implementation of CvT: Introducing Convolutions to Vision Transformers.☆227Updated 3 years ago
- ☆56Updated 4 years ago
- Mutual Information in Pytorch☆113Updated 2 years ago
- 🔬 Some personal research code on analyzing CNNs. Started with a thorough exploration of Stanford's Tiny-Imagenet-200 dataset.☆105Updated 6 years ago