Alternatives and similar repositories for SReT:

Users that are interested in SReT are comparing it to the libraries listed below

• ziplab / SPViT
  [TPAMI 2024] This is the official repository for our paper: ''Pruning Self-attentions into Convolutional Layers in Single Path''.
  ☆112Updated last year
• ziplab / HVT
  [ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"
  ☆33Updated 3 years ago
• lmbxmu / SuperViT
  Official Pytorch implementation of Super Vision Transformer (IJCV)
  ☆43Updated last year
• ggjy / Hire-Wave-MLP.pytorch
  Implementation of Hire-MLP: Vision MLP via Hierarchical Rearrangement and An Image Patch is a Wave: Phase-Aware Vision MLP.
  ☆37Updated 2 years ago
• YifanXu74 / Evo-ViT
  Official implement of Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformer
  ☆71Updated 2 years ago
• LiuDongyang6 / FCFD
  Official implementation of the paper "Function-Consistent Feature Distillation" (ICLR 2023)
  ☆29Updated last year
• zhoudaquan / Refiner_ViT
  ☆108Updated 3 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago
• yucornetto / GG-Transformer
  Code and models for the paper Glance-and-Gaze Vision Transformer
  ☆28Updated 3 years ago
• hunto / DyRep
  Official implementation for paper "DyRep: Bootstrapping Training with Dynamic Re-parameterization", CVPR 2022
  ☆43Updated 2 years ago
• ma-xu / FCViT
  A Close Look at Spatial Modeling: From Attention to Convolution
  ☆91Updated 2 years ago
• Shanghua-Gao / RBN
  The official repo of the CVPR2021 oral paper: Representative Batch Normalization with Feature Calibration
  ☆86Updated 2 years ago
• MengLcool / AdaViT
  [CVPR-22] This is the official implementation of the paper "Adavit: Adaptive vision transformers for efficient image recognition".
  ☆52Updated 2 years ago
• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆74Updated last year
• Sense-X / UniNet
  Unified Architecture Search with Convolution, Transformer, and MLP (ECCV 2022)
  ☆53Updated 2 years ago
• ggjy / FastMIM.pytorch
  FastMIM, official pytorch implementation of our paper "FastMIM: Expediting Masked Image Modeling Pre-training for Vision"(https://arxiv.o…
  ☆39Updated 2 years ago
• ziplab / LIT
  [AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"
  ☆96Updated 2 years ago
• pzhren / DW-ViT
  ☆33Updated 3 years ago
• junchen14 / LoMaR
  LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)
  ☆63Updated 2 weeks ago
• moabarar / qna
  [CVPR2022 - Oral] Official Jax Implementation of Learned Queries for Efficient Local Attention
  ☆116Updated 3 years ago
• TencentARC / ConMIM
  Official codes for ConMIM (ICLR 2023)
  ☆58Updated 2 years ago
• OpenGVLab / STM-Evaluation
  ☆72Updated last month
• OSVAI / NORM
  The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…
  ☆20Updated last year
• StevenGrove / vtpack
  code base for vision transformers
  ☆36Updated 3 years ago
• allenai / container
  ☆57Updated 3 years ago
• liyunsheng13 / dcd
  official code for dynamic convolution decomposition
  ☆131Updated 3 years ago
• PeixianChen / DFFT
  ☆76Updated 2 years ago
• megvii-research / LGD
  Official Implementation of the detection self-distillation framework LGD.
  ☆52Updated 3 years ago
• bychen515 / GLiT
  ☆24Updated 3 years ago
• megvii-research / zipfls
  This repo is the official megengine implementation of the ECCV2022 paper: Efficient One Pass Self-distillation with Zipf's Label Smoothin…
  ☆26Updated 2 years ago