Alternatives and similar repositories for G2SD:

Users that are interested in G2SD are comparing it to the libraries listed below

• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆103Updated last year
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆92Updated 2 years ago
• yzd-v / cls_KD
  'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)
  ☆222Updated last year
• Haoqing-Wang / LocalMIM
  [CVPR 2023 Highlight] Masked Image Modeling with Local Multi-Scale Reconstruction
  ☆46Updated last year
• zhangxiaosong18 / hivit
  ☆58Updated last year
• lkhl / tiny-transformers
  [ECCV 2022] Implementation of the paper "Locality Guidance for Improving Vision Transformers on Tiny Datasets"
  ☆77Updated 2 years ago
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆110Updated 9 months ago
• ChenMnZ / CF-ViT
  (AAAI 2023 Oral) Pytorch implementation of "CF-ViT: A General Coarse-to-Fine Method for Vision Transformer"
  ☆103Updated last year
• haohang96 / MRA
  ☆58Updated 2 years ago
• Sense-X / MixMIM
  MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning
  ☆134Updated last year
• YuqiYang213 / MLoRE
  Project Page for "Multi-Task Dense Prediction via Mixture of Low-Rank Experts"
  ☆60Updated last month
• JieShibo / PETL-ViT
  [ICCV 2023 & AAAI 2023] Binary Adapters & FacT, [Tech report] Convpass
  ☆175Updated last year
• liuxingbin / dbot
  [ICLR2024] Exploring Target Representations for Masked Autoencoders
  ☆52Updated last year
• TonyLianLong / UnsupervisedSelectiveLabeling
  [ECCV 2022] Official Implementation for Unsupervised Selective Labeling for More Effective Semi-Supervised Learning
  ☆60Updated last year
• GzyAftermath / CAT-KD
  CVPR 2023, Class Attention Transfer Based Knowledge Distillation
  ☆37Updated last year
• CVMI-Lab / KDEP
  (CVPR2022) Official PyTorch Implementation of KDEP. Knowledge Distillation as Efficient Pre-training: Faster Convergence, Higher Data-eff…
  ☆61Updated 2 years ago
• scok30 / MAE-CIL
  Official implementation of the paper "Masked Autoencoders are Efficient Class Incremental Learners"
  ☆39Updated 7 months ago
• chenyd7 / PEFD
  [NeurIPS'22] Projector Ensemble Feature Distillation
  ☆29Updated last year
• junchen14 / LoMaR
  LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)
  ☆62Updated 2 years ago
• Haochen-Wang409 / HPM
  [CVPR'23] Hard Patches Mining for Masked Image Modeling
  ☆89Updated last year
• ArchipLab-LinfengZhang / contrastive-deep-supervision
  Codes for ECCV2022 paper - contrastive deep supervision
  ☆68Updated 2 years ago
• sunsmarterjie / iTPN
  (CVPR2023/TPAMI2024) Integrally Pre-Trained Transformer Pyramid Networks -- A Hierarchical Vision Transformer for Masked Image Modeling
  ☆183Updated 6 months ago
• encounter1997 / FP-DETR
  Official Implementation of "FP-DETR: Detection Transformer Advanced by Fully Pre-training"
  ☆61Updated 2 years ago
• SwinTransformer / Feature-Distillation
  ☆245Updated 2 years ago
• lxtGH / CAE
  This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"
  ☆193Updated 2 years ago
• wangsr126 / MAE-Lite
  Official implement for ICML2023 paper: "A Closer Look at Self-Supervised Lightweight Vision Transformers"
  ☆122Updated last year
• AbrahamYabo / SdAE
  ☆57Updated last year
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆163Updated last month
• winycg / CLIP-KD
  [CVPR-2024] Official implementations of CLIP-KD: An Empirical Study of CLIP Model Distillation
  ☆94Updated 6 months ago
• hunto / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆68Updated last year