UdbhavPrasad072300 / Transformer-Implementations
Library - Vanilla, ViT, DeiT, BERT, GPT
☆62Updated 2 years ago
Related projects: ⓘ
- [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"☆139Updated 10 months ago
- Recent Advances on Efficient Vision Transformers☆46Updated last year
- Simple CIFAR-10 classification with ConvMixer☆40Updated 2 years ago
- ☆194Updated last month
- Implementation of Visual Transformer for Small-size Datasets☆116Updated 2 years ago
- Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …☆100Updated 5 months ago
- Implementation of Swin Transformer with Pytorch☆103Updated 3 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆77Updated 6 months ago
- [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers☆97Updated last year
- Sequencer: Deep LSTM for Image Classification☆138Updated last year
- Implementation of AAAI 2022 Paper: Go wider instead of deeper☆32Updated last year
- [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021☆164Updated last year
- A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.☆118Updated 9 months ago
- 2D discrete Wavelet Transform for Image Classification and Segmentation☆70Updated 4 months ago
- Vision Transformer Pruning☆52Updated 2 years ago
- Pytorch implementation of ViT on CIFAR-10.☆16Updated 3 years ago
- Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)☆145Updated 2 years ago
- Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision☆207Updated 3 years ago
- [ICLR 2023] "More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsity"; [ICML 2023] "Are Large Kernels Better Teachers…☆263Updated last year
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆67Updated last year
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆133Updated last year
- ☆45Updated 2 years ago
- Code and models for mobile-former☆116Updated 2 years ago
- A collection of SOTA Image Classification Models in PyTorch☆134Updated 2 years ago
- ☆64Updated 3 years ago
- [ICLR 2023] This repository includes the official implementation our paper "Can CNNs Be More Robust Than Transformers?"☆143Updated last year
- A summarization of Transformer-based architectures for CV tasks, including image classification, object detection, segmentation, and Few-…☆104Updated 2 years ago
- ☆57Updated 3 years ago
- [CVPR 2021] CondenseNet V2: Sparse Feature Reactivation for Deep Networks☆85Updated 2 years ago
- Implementation of Convolutional enhanced image Transformer☆100Updated 3 years ago