UdbhavPrasad072300 / Transformer-Implementations
Library - Vanilla, ViT, DeiT, BERT, GPT
☆65Updated 3 years ago
Alternatives and similar repositories for Transformer-Implementations
Users that are interested in Transformer-Implementations are comparing it to the libraries listed below
Sorting:
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆152Updated last year
- Transformers trained on Tiny ImageNet☆54Updated 2 years ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆107Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆71Updated 2 years ago
- Pytorch implementation of ViT on CIFAR-10.☆17Updated 4 years ago
- Simple CIFAR-10 classification with ConvMixer☆43Updated 3 years ago
- Implementation of Visual Transformer for Small-size Datasets☆123Updated 3 years ago
- ☆199Updated 9 months ago
- Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations☆184Updated last year
- Recent Advances on Efficient Vision Transformers☆50Updated 2 years ago
- Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…☆169Updated 2 years ago
- Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"☆40Updated 2 years ago
- [NeurIPS 2021] [T-PAMI] Global Filter Networks for Image Classification☆474Updated last year
- [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…☆52Updated last year
- ☆50Updated 2 years ago
- Pytorch implementation of some vision transformers, trained on CIFAR-10.☆29Updated 3 years ago
- Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …☆114Updated last year
- Sequencer: Deep LSTM for Image Classification☆143Updated 2 years ago
- Code for paper: Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networks☆107Updated 3 years ago
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch☆48Updated 2 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆197Updated 2 years ago
- PyTorch implementation for Vision Transformer[Dosovitskiy, A.(ICLR'21)] modified to obtain over 90% accuracy FROM SCRATCH on CIFAR-10 wit…☆191Updated last year
- ☆24Updated last year
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆217Updated 4 years ago
- S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)☆64Updated 3 years ago
- Vision Transformer Pruning☆57Updated 3 years ago
- Demonstration of transfer of knowledge and generalization with distillation☆53Updated 6 years ago
- [NeurIPS 2022] “M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design”, Hanxue …☆116Updated 2 years ago