omihub777 / ViT-CIFARLinks
PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 with small number of parameters (= 6.3M, originally ViT-B has 86M).
☆199Updated last year
Alternatives and similar repositories for ViT-CIFAR
Users that are interested in ViT-CIFAR are comparing it to the libraries listed below
Sorting:
- Reproduce CKA: Similarity of Neural Network Representations Revisited☆311Updated 5 years ago
- (Pytorch) Training ResNets on ImageNet-100 data☆63Updated 3 years ago
- Approximating neural network loss landscapes in low-dimensional parameter subspaces for PyTorch☆341Updated last year
- Compare neural networks by their feature similarity☆374Updated 2 years ago
- An Numpy and PyTorch Implementation of CKA-similarity with CUDA support☆94Updated 4 years ago
- pytorch-tiny-imagenet☆181Updated this week
- Transformers trained on Tiny ImageNet☆57Updated last month
- Let's train vision transformers (ViT) for cifar 10 / cifar 100!☆671Updated last month
- ☆17Updated 2 years ago
- PyTorch implementation of Mixer-nano (#parameters is 0.67M, originally Mixer-S/16 has 18M) with 90.83 % acc. on CIFAR-10. Training from s…☆35Updated 3 years ago
- ☆36Updated 2 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆28Updated last year
- Train ImageNet *fast* in 500 lines of code with FFCV☆146Updated last year
- The official PyTorch implementation - Can Neural Nets Learn the Same Model Twice? Investigating Reproducibility and Double Descent from t…☆83Updated 3 years ago
- Official code for our CVPR '22 paper "Dataset Distillation by Matching Training Trajectories"☆429Updated last year
- Official [ICLR] Code Repository for "Gradient Projection Memory for Continual Learning"☆95Updated 4 years ago
- This repo shows an easy way to download imagenet on a remote server☆45Updated 3 years ago
- Pretrained models on CIFAR10/100 in PyTorch☆366Updated 4 months ago
- [TPAMI 2023] Low Dimensional Landscape Hypothesis is True: DNNs can be Trained in Tiny Subspaces☆42Updated 3 years ago
- Pytorch implementation of the paper Exploring Simple Siamese Representation Learning.☆75Updated 4 years ago
- PyTorch repository for ICLR 2022 paper (GSAM) which improves generalization (e.g. +3.8% top-1 accuracy on ImageNet with ViT-B/32)☆144Updated 3 years ago
- Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …☆113Updated last year
- [AAAI-2022] Up to 100x Faster Data-free Knowledge Distillation☆73Updated 2 years ago
- PyTorch implementation of Masked Autoencoder☆271Updated 2 years ago
- Official PyTorch implementation of "Dataset Condensation via Efficient Synthetic-Data Parameterization" (ICML'22)☆113Updated last year
- Pytorch SimCLR on CIFAR10 (92.85% test accuracy)☆58Updated 5 years ago
- Mode Connectivity and Fast Geometric Ensembles in PyTorch☆275Updated 2 years ago
- Dataset Condensation (ICLR21 and ICML21)☆525Updated last year
- A PyTorch implementation of Centered Kernel Alignment (CKA) with GPU acceleration.☆52Updated last year
- Code release for REPAIR: REnormalizing Permuted Activations for Interpolation Repair☆49Updated last year