UdbhavPrasad072300 / Transformer-Implementations
Library - Vanilla, ViT, DeiT, BERT, GPT
☆65Updated 3 years ago
Alternatives and similar repositories for Transformer-Implementations:
Users that are interested in Transformer-Implementations are comparing it to the libraries listed below
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆151Updated last year
- Simple CIFAR-10 classification with ConvMixer☆43Updated 3 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- Transformers trained on Tiny ImageNet☆54Updated 2 years ago
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆71Updated 2 years ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆107Updated 2 years ago
- ResMLP: Feedforward networks for image classification with data-efficient training☆42Updated 3 years ago
- Code for You Only Cut Once: Boosting Data Augmentation with a Single Cut, ICML 2022.☆104Updated last year
- [T-IP 2023] Code for exponential adaptive pooling for PyTorch☆82Updated 2 years ago
- Implementation of ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networks, ICML 2021.☆141Updated 3 years ago
- Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"☆131Updated last month
- Pytorch reimplementation of the Mixer (MLP-Mixer: An all-MLP Architecture for Vision)☆35Updated 3 years ago
- Recent Advances on Efficient Vision Transformers☆50Updated 2 years ago
- Official codebase for our paper "Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks"☆12Updated 3 years ago
- ☆198Updated 8 months ago
- The official code of Relevance-CAM☆43Updated last year
- This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).☆77Updated last month
- A TensorFlow 2.x implementation of Masked Autoencoders Are Scalable Vision Learners☆78Updated 2 years ago
- Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.☆32Updated 2 years ago
- Sequencer: Deep LSTM for Image Classification☆142Updated 2 years ago
- ☆24Updated 3 years ago
- Pytorch implementation of some vision transformers, trained on CIFAR-10.☆29Updated 3 years ago
- Implementation of Visual Transformer for Small-size Datasets☆121Updated 3 years ago
- [ICLR 2022] "Deep AutoAugment" by Yu Zheng, Zhi Zhang, Shen Yan, Mi Zhang☆64Updated 7 months ago
- Pytorch implementation of ViT on CIFAR-10.☆17Updated 3 years ago
- ZSKD with PyTorch☆30Updated last year
- A database of over 1.4 billion 3x3 convolution filters extracted from hundreds of diverse CNN models with relevant meta information (CVPR…☆32Updated last year
- Implementation of AAAI 2022 Paper: Go wider instead of deeper☆32Updated 2 years ago
- ☆24Updated last year
- A PyTorch implementation of CMT based on paper CMT: Convolutional Neural Networks Meet Vision Transformers.☆70Updated 2 years ago