omihub777 / ViT-CIFARLinks
PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 with small number of parameters (= 6.3M, originally ViT-B has 86M).
☆194Updated last year
Alternatives and similar repositories for ViT-CIFAR
Users that are interested in ViT-CIFAR are comparing it to the libraries listed below
Sorting:
- Let's train vision transformers (ViT) for cifar 10 / cifar 100!☆647Updated last month
- Pretrained models on CIFAR10/100 in PyTorch☆355Updated 2 weeks ago
- Transformers trained on Tiny ImageNet☆54Updated 2 years ago
- pytorch-tiny-imagenet☆176Updated last year
- Compare neural networks by their feature similarity☆361Updated 2 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆32Updated 3 years ago
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆303Updated 5 years ago
- Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch☆332Updated last year
- An Numpy and PyTorch Implementation of CKA-similarity with CUDA support☆91Updated 4 years ago
- (Pytorch) Training ResNets on ImageNet-100 data☆59Updated 3 years ago
- ☆17Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆145Updated 3 years ago
- Fine-tuning Vision Transformers on various classification datasets☆106Updated 9 months ago
- Train ImageNet *fast* in 500 lines of code with FFCV☆142Updated last year
- Official [ICLR] Code Repository for "Gradient Projection Memory for Continual Learning"☆90Updated 3 years ago
- Pytorch SimCLR on CIFAR10 (92.85% test accuracy)☆57Updated 5 years ago
- Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"☆424Updated 10 months ago
- Benchmark your model on out-of-distribution datasets with carefully collected human comparison data (NeurIPS 2021 Oral)☆349Updated last month
- Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …☆114Updated last year
- ImageNet-R(endition) and DeepAugment (ICCV 2021)☆267Updated 3 years ago
- PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)☆143Updated 2 years ago
- Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.☆74Updated 4 years ago
- mini-imagenet and tiny-imagent dataset transformation for traditional classification task and also for the format for few-shot learning /…☆29Updated 2 years ago
- ☆35Updated 2 years ago
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆154Updated last year
- Git Re-Basin: Merging Models modulo Permutation Symmetries in PyTorch☆75Updated 2 years ago
- PyHessian is a Pytorch library for second-order based analysis and training of Neural Networks☆740Updated last year
- Dataset Condensation (ICLR21 and ICML21)☆513Updated last year
- Tiny-ImageNet Classifier using Pytorch☆90Updated 6 years ago
- The official PyTorch implementation - Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent from t…☆78Updated 3 years ago