UdbhavPrasad072300 / Transformer-Implementations
Library - Vanilla, ViT, DeiT, BERT, GPT
☆63Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for Transformer-Implementations
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆141Updated last year
- Implementation of Visual Transformer for Small-size Datasets☆117Updated 2 years ago
- Sequencer: Deep LSTM for Image Classification☆139Updated 2 years ago
- Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …☆103Updated 7 months ago
- ☆195Updated 3 months ago
- Implementation of Swin Transformer with Pytorch☆107Updated 3 years ago
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆164Updated 2 years ago
- Simple CIFAR-10 classification with ConvMixer☆41Updated 2 years ago
- Implementation of Convolutional enhanced image Transformer☆101Updated 3 years ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆101Updated last year
- Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)☆149Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆209Updated 3 years ago
- This repo is for our paper: Normalization Techniques in Training DNNs: Methodology, Analysis and Application☆84Updated 3 years ago
- code for NASViT☆66Updated 2 years ago
- A highly modular PyTorch framework with a focus on Neural Architecture Search (NAS).☆22Updated 2 years ago
- [T-IP 2023] Code for exponential adaptive pooling for PyTorch☆81Updated last year
- ResMLP: Feedforward networks for image classification with data-efficient training☆40Updated 3 years ago
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆68Updated last year
- Simple implementation of Mobile-Former on Pytorch☆108Updated 3 years ago
- [ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers…☆264Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆119Updated 11 months ago
- Nested Hierarchical Transformer https://arxiv.org/pdf/2105.12723.pdf☆193Updated 3 months ago
- ☆57Updated 3 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆81Updated 8 months ago
- A TensorFlow 2.x implementation of Masked Autoencoders Are Scalable Vision Learners☆76Updated 2 years ago
- Vision Transformer Pruning☆54Updated 2 years ago
- Transformers trained on Tiny ImageNet☆47Updated 2 years ago
- Code for paper: Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networks☆107Updated 2 years ago
- [NeurIPS 2022] “M³ViT: Mixture-of-Experts Vision Transformer for Efficient Multi-task Learning with Model-Accelerator Co-design”, Hanxue …☆99Updated last year
- (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better☆43Updated 3 years ago