Alternatives and similar repositories for Transformer-Implementations

Users that are interested in Transformer-Implementations are comparing it to the libraries listed below

• hananshafi / vits-for-small-scale-datasets
  [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"
  ☆154Updated last year
• WangFeng18 / Swin-Transformer
  Implementation of Swin Transformer with Pytorch
  ☆112Updated 4 years ago
• ehuynh1106 / TinyImageNet-Transformers
  Transformers trained on Tiny ImageNet
  ☆54Updated 2 years ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• coeusguo / ceit
  ☆62Updated 3 years ago
• locuslab / convmixer-cifar10
  Simple CIFAR-10 classification with ConvMixer
  ☆43Updated 3 years ago
• okojoalg / sequencer
  Sequencer: Deep LSTM for Image Classification
  ☆143Updated 2 years ago
• saic-fi / edgevit
  [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers
  ☆107Updated 2 years ago
• rishikksh20 / ResMLP-pytorch
  ResMLP: Feedforward networks for image classification with data-efficient training
  ☆42Updated 4 years ago
• wilile26811249 / CMT_CNN-meet-Vision-Transformer
  A PyTorch implementation of CMT based on paper CMT: Convolutional Neural Networks Meet Vision Transformers.
  ☆70Updated 2 years ago
• liuruiyang98 / Jittor-MLP
  Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…
  ☆169Updated 2 years ago
• ggjy / Hire-Wave-MLP.pytorch
  Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.
  ☆37Updated 2 years ago
• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆79Updated last year
• haofanwang / awesome-mlp-papers
  Recent Advances in MLP-based Models (MLP is all you need!)
  ☆115Updated 2 years ago
• microsoft / SPACH
  ☆200Updated 10 months ago
• alexandrosstergiou / adaPool
  [T-IP 2023] Code for exponential adaptive pooling for PyTorch
  ☆82Updated 2 years ago
• NVlabs / A-ViT
  Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)
  ☆156Updated 2 years ago
• abhuse / polyloss-pytorch
  Polyloss Pytorch Implementation
  ☆44Updated 3 years ago
• ra1ph2 / Vision-Transformer
  Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …
  ☆114Updated last year
• haohang96 / MRA
  ☆57Updated 2 years ago
• jeonsworld / MLP-Mixer-Pytorch
  Pytorch reimplementation of the Mixer (MLP-Mixer: An all-MLP Architecture for Vision)
  ☆36Updated 4 years ago
• youweiliang / evit
  Python code for ICLR 2022 spotlight paper EViT: Expediting Vision Transformers via Token Reorganizations
  ☆185Updated last year
• aanna0701 / SPT_LSA_ViT
  Implementation of Visual Transformer for Small-size Datasets
  ☆124Updated 3 years ago
• MingSun-Tse / Awesome-Efficient-ViT
  Recent Advances on Efficient Vision Transformers
  ☆51Updated 2 years ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆93Updated last year
• pprp / Vision-Mamba-CIFAR10
  ☆23Updated last year
• rishikksh20 / CeiT-pytorch
  Implementation of Convolutional enhanced image Transformer
  ☆104Updated 4 years ago
• ChristophReich1996 / MaxViT
  PyTorch reimplementation of the paper "MaxViT: Multi-Axis Vision Transformer" [ECCV 2022].
  ☆162Updated last year
• ma-xu / FCViT
  A Close Look at Spatial Modeling: From Attention to Convolution
  ☆91Updated 2 years ago
• lkhl / tiny-transformers
  [ECCV 2022] Implementation of the paper "Locality Guidance for Improving Vision Transformers on Tiny Datasets"
  ☆79Updated 2 years ago