Alternatives and similar repositories for Transformer-SSL

Users that are interested in Transformer-SSL are comparing it to the libraries listed below

• Sara-Ahmed / SiT
  Self-supervised vIsion Transformer (SiT)
  ☆332Updated 2 years ago
• microsoft / SimMIM
  This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling".
  ☆980Updated 2 years ago
• microsoft / Focal-Transformer
  [NeurIPS 2021 Spotlight] Official code for "Focal Self-attention for Local-Global Interactions in Vision Transformers"
  ☆556Updated 3 years ago
• facebookresearch / moco-v3
  PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057
  ☆1,272Updated 3 years ago
• WXinlong / DenseCL
  Dense Contrastive Learning (DenseCL) for self-supervised representation learning, CVPR 2021 Oral.
  ☆560Updated last year
• facebookresearch / convit
  Code for the Convolutional Vision Transformer (ConViT)
  ☆465Updated 3 years ago
• microsoft / esvit
  EsViT: Efficient self-supervised Vision Transformers
  ☆413Updated last year
• csrhddlam / axial-deeplab
  This is a PyTorch re-implementation of Axial-DeepLab (ECCV 2020 Spotlight)
  ☆456Updated 3 years ago
• microsoft / CSWin-Transformer
  CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped, CVPR 2022
  ☆570Updated last year
• yitu-opensource / T2T-ViT
  ICCV2021, Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNet
  ☆1,188Updated last year
• Meituan-AutoML / Twins
  Two simple and effective designs of vision transformer, which is on par with the Swin transformer
  ☆601Updated 2 years ago
• zihangJiang / TokenLabeling
  Pytorch implementation of "All Tokens Matter: Token Labeling for Training Better Vision Transformers"
  ☆428Updated last year
• Alpha-VL / ConvMAE
  ConvMAE: Masked Convolution Meets Masked Autoencoders
  ☆507Updated 2 years ago
• bytedance / ibot
  iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)
  ☆729Updated 3 years ago
• microsoft / CvT
  This is an official implementation of CvT: Introducing Convolutions to Vision Transformers.
  ☆578Updated 2 years ago
• berniwal / swin-transformer-pytorch
  Implementation of the Swin Transformer in PyTorch.
  ☆834Updated 4 years ago
• sail-sg / poolformer
  PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
  ☆1,341Updated last year
• whai362 / PVT
  Official implementation of PVT series
  ☆1,824Updated 2 years ago
• facebookresearch / simsiam
  PyTorch implementation of SimSiam https//arxiv.org/abs/2011.10566
  ☆1,196Updated 2 years ago
• facebookresearch / MaskFormer
  Per-Pixel Classification is Not All You Need for Semantic Segmentation (NeurIPS 2021, spotlight)
  ☆1,408Updated 3 years ago
• PatrickHua / SimSiam
  A pytorch implementation for paper 'Exploring Simple Siamese Representation Learning'
  ☆829Updated 2 years ago
• lucidrains / transformer-in-transformer
  Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorc…
  ☆305Updated 3 years ago
• JDAI-CV / CoTNet
  This is an official implementation for "Contextual Transformer Networks for Visual Recognition".
  ☆532Updated 3 years ago
• wofmanaf / ResT
  This is an official implementation for "ResT: An Efficient Transformer for Visual Recognition".
  ☆285Updated 2 years ago
• facebookresearch / LeViT
  LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference
  ☆613Updated 2 years ago
• dingmyu / davit
  [ECCV 2022]Code for paper "DaViT: Dual Attention Vision Transformer"
  ☆358Updated last year
• zdaxie / PixPro
  Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learning, CVPR 2021
  ☆351Updated 3 years ago
• asyml / vision-transformer-pytorch
  Pytorch version of Vision Transformer (ViT) with pretrained models. This is part of CASL (https://casl-project.github.io/) and ASYML proj…
  ☆352Updated 4 years ago
• lucidrains / pixel-level-contrastive-learning
  Implementation of Pixel-level Contrastive Learning, proposed in the paper "Propagate Yourself", in Pytorch
  ☆259Updated 4 years ago
• facebookresearch / msn
  Masked Siamese Networks for Label-Efficient Learning (https://arxiv.org/abs/2204.07141)
  ☆455Updated 3 years ago