Alternatives and similar repositories for MAE-Lite:

Users that are interested in MAE-Lite are comparing it to the libraries listed below

• yzd-v / cls_KD
  'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
  ☆224Updated last year
• ggjy / CMT.pytorch
  CMT Pytorch implementation of our CVPR 2022 paper CMT: Convolutional Neural Networks Meet Vision Transformers (https://arxiv.org/pdf/2107…
  ☆95Updated 2 years ago
• pengzhiliang / G2SD
  ☆85Updated last year
• Gumpest / FreeKD
  [CVPR'24] Official implementation of paper "FreeKD: Knowledge Distillation via Semantic Frequency Prompt".
  ☆37Updated 10 months ago
• megvii-research / RevCol
  Official Code of Paper "Reversible Column Networks" "RevColv2"
  ☆257Updated last year
• zhangxiaosong18 / hivit
  ☆59Updated last year
• AAboys / MobileFormer
  Code and models for mobile-former
  ☆121Updated 2 years ago
• hunto / LightViT
  Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"
  ☆137Updated 2 years ago
• LayneH / GreenMIM
  [NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.
  ☆173Updated 2 years ago
• lxtGH / CAE
  This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"
  ☆193Updated 2 years ago
• sail-sg / iFormer
  iFormer: Inception Transformer
  ☆246Updated 2 years ago
• HVision-NKU / Conv2Former
  ☆170Updated last month
• SwinTransformer / Feature-Distillation
  ☆249Updated 2 years ago
• yzd-v / MGD
  Masked Generative Distillation (ECCV 2022)
  ☆216Updated 2 years ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆103Updated last year
• sunsmarterjie / iTPN
  (CVPR2023/TPAMI2024) Integrally Pre-Trained Transformer Pyramid Networks -- A Hierarchical Vision Transformer for Masked Image Modeling
  ☆186Updated 6 months ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated 11 months ago
• OliverRensu / Shunted-Transformer
  ☆213Updated 3 years ago
• hhb072 / STViT
  ☆133Updated 7 months ago
• Jasonlee1995 / ImageNet-1K
  ImageNet-1K data download, processing for using as a dataset
  ☆80Updated 2 years ago
• ziplab / LITv2
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "Fast Vision Transformers with HiLo Attention"
  ☆267Updated last year
• ChenMnZ / CF-ViT
  (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"
  ☆103Updated last year
• Alpha-VL / ConvMAE
  ConvMAE: Masked Convolution Meets Masked Autoencoders
  ☆491Updated last year
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆108Updated 10 months ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆140Updated 2 years ago
• lkhl / tiny-transformers
  [ECCV 2022] Implementation of the paper "Locality Guidance for Improving Vision Transformers on Tiny Datasets"
  ☆78Updated 2 years ago
• LeapLabTHU / EfficientTrain
  1.5−3.0× lossless training or pre-training speedup. An off-the-shelf, easy-to-implement algorithm for the efficient training of foundatio…
  ☆217Updated 5 months ago
• Haochen-Wang409 / HPM
  [CVPR'23] Hard Patches Mining for Masked Image Modeling
  ☆90Updated last year
• implus / UM-MAE
  Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"
  ☆243Updated 2 years ago
• ziplab / SN-Net
  [CVPR 2023 Highlight] This is the official implementation of "Stitchable Neural Networks".
  ☆248Updated last year