UdbhavPrasad072300 / Transformer-Implementations
Library - Vanilla, ViT, DeiT, BERT, GPT
☆64Updated 3 years ago
Alternatives and similar repositories for Transformer-Implementations:
Users that are interested in Transformer-Implementations are comparing it to the libraries listed below
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆147Updated last year
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆105Updated last year
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago
- Transformers trained on Tiny ImageNet☆52Updated 2 years ago
- ☆48Updated 2 years ago
- Simple CIFAR-10 classification with ConvMixer☆43Updated 3 years ago
- Implementation of AAAI 2022 Paper: Go wider instead of deeper☆32Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆217Updated 3 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- Recent Advances on Efficient Vision Transformers☆49Updated 2 years ago
- ☆59Updated 3 years ago
- [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…☆79Updated last year
- Transformers w/o Attention, based fully on MLPs☆93Updated 10 months ago
- Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"☆41Updated 2 years ago
- code for NASViT☆67Updated 2 years ago
- Implementation of Visual Transformer for Small-size Datasets☆119Updated 2 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated 11 months ago
- Sequencer: Deep LSTM for Image Classification☆140Updated 2 years ago
- PyTorch reimplementation of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" (2D and 3D Involution) …☆105Updated 2 years ago
- Implementation of ResMLP, an all MLP solution to image classification, in Pytorch☆197Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆72Updated 2 years ago
- [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…☆52Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆125Updated 2 months ago
- ☆23Updated last year
- ☆58Updated 2 years ago
- Github repository for the paper Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers.☆25Updated 4 months ago
- Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…☆170Updated 2 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- SpinalNet: Deep Neural Network with Gradual Input☆172Updated 8 months ago