Alternatives and similar repositories for Transformer-Implementations

Users that are interested in Transformer-Implementations are comparing it to the libraries listed below

• ra1ph2 / Vision-Transformer
  Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …
  ☆114Updated last year
• rishikksh20 / MLP-Mixer-pytorch
  Unofficial implementation of MLP-Mixer: An all-MLP Architecture for Vision
  ☆218Updated 4 years ago
• haofanwang / awesome-mlp-papers
  Recent Advances in MLP-based Models (MLP is all you need!)
  ☆116Updated 2 years ago
• rishikksh20 / ResMLP-pytorch
  ResMLP: Feedforward networks for image classification with data-efficient training
  ☆45Updated 4 years ago
• hananshafi / vits-for-small-scale-datasets
  [BMVC 2022] Official repository for "How to Train Vision Transformer on Small-scale Datasets?"
  ☆162Updated last year
• seungjunlee96 / Depthwise-Separable-Convolution_Pytorch
  Implementation of Depthwise Separable Convolution (pytorch)
  ☆81Updated 5 years ago
• lucidrains / res-mlp-pytorch
  Implementation of ResMLP, an all MLP solution to image classification, in Pytorch
  ☆200Updated 2 years ago
• microsoft / SPACH
  ☆201Updated last year
• saic-fi / edgevit
  [ECCV 2022] EdgeViT: Competing Light-weight CNNs on Mobile Devices with Vision Transformers
  ☆110Updated 2 years ago
• szq0214 / SReT
  Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"
  ☆66Updated 3 years ago
• abhuse / cyclic-cosine-decay
  Pytorch cyclic cosine decay learning rate scheduler
  ☆49Updated 4 years ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆84Updated last year
• jeonsworld / MLP-Mixer-Pytorch
  Pytorch reimplementation of the Mixer (MLP-Mixer: An all-MLP Architecture for Vision)
  ☆36Updated 4 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆43Updated 3 years ago
• okojoalg / sequencer
  Sequencer: Deep LSTM for Image Classification
  ☆143Updated 3 years ago
• liuruiyang98 / Jittor-MLP
  Unofficial Implementation of MLP-Mixer, gMLP, resMLP, Vision Permutator, S2MLP, S2MLPv2, RaftMLP, HireMLP, ConvMLP, AS-MLP, SparseMLP, Co…
  ☆169Updated 3 years ago
• FlyEgle / MAE-pytorch
  Masked Autoencoders Are Scalable Vision Learners
  ☆250Updated 2 years ago
• Hao840 / manifold-distillation
  Learning Efficient Vision Transformers via Fine-Grained Manifold Distillation. NeurIPS 2022.
  ☆32Updated 2 years ago
• PatrickHua / SimpleMAE
  ☆24Updated 3 years ago
• quanlin-wu / dmae
  Denoising Masked Autoencoders Help Robust Classification.
  ☆67Updated 2 years ago
• wilile26811249 / CMT_CNN-meet-Vision-Transformer
  A PyTorch implementation of CMT based on paper CMT: Convolutional Neural Networks Meet Vision Transformers.
  ☆71Updated 2 years ago
• coeusguo / ceit
  ☆63Updated 4 years ago
• Jack-Etheredge / early_convolutions_vit_pytorch
  (Unofficial) PyTorch implementation of the paper Early Convolutions Help Transformers See Better
  ☆43Updated 4 years ago
• ShreyPandit / Ablation-Cam
  Implementation of the research paper of Cam which is the alternative to the current SOTA
  ☆28Updated 3 years ago
• pprp / PyTorch-CIFAR-Model-Hub
  Implementation of Conv-based and Vit-based networks designed for CIFAR.
  ☆70Updated 2 years ago
• zhoudaquan / dvit_repo
  ☆140Updated 3 years ago
• SHI-Labs / Convolutional-MLPs
  [Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021
  ☆167Updated 3 years ago
• aanna0701 / SPT_LSA_ViT
  Implementation of Visual Transformer for Small-size Datasets
  ☆125Updated 3 years ago
• locuslab / convmixer-cifar10
  Simple CIFAR-10 classification with ConvMixer
  ☆45Updated 3 years ago
• ChristophReich1996 / Involution
  PyTorch reimplementation of the paper "Involution: Inverting the Inherence of Convolution for Visual Recognition" (2D and 3D Involution) …
  ☆105Updated 3 years ago