Alternatives and similar repositories for EcoFormer

Users that are interested in EcoFormer are comparing it to the libraries listed below

• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• ziplab / Mesa
  This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".
  ☆121Updated 3 years ago
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆33Updated 2 years ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆53Updated last year
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆31Updated 2 years ago
• VITA-Group / SViTE
  [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…
  ☆89Updated last year
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated last month
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated 8 months ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆18Updated 3 years ago
• bellymonster / Weighted-Soft-Label-Distillation
  ☆58Updated 4 years ago
• szq0214 / SReT
  Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"
  ☆66Updated 3 years ago
• xiusu / ViTAS
  Code for ViTAS_Vision Transformer Architecture Search
  ☆50Updated 4 years ago
• facebookresearch / NASViT
  code for NASViT
  ☆66Updated 3 years ago
• facebookresearch / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆72Updated 3 years ago
• CownowAn / DaSS
  Official PyTorch implementation of "Meta-prediction Model for Distillation-Aware NAS on Unseen Datasets" (ICLR 2023 notable top 25%)
  ☆26Updated last year
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆30Updated last year
• ofsoundof / random_channel_pruning
  ☆17Updated 3 years ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆95Updated last year
• skhu101 / GM-NAS
  Code for our ICLR'2022 paper "Generalizing Few-Shot NAS with Gradient Matching"
  ☆22Updated 2 years ago
• MingSun-Tse / Awesome-Efficient-ViT
  Recent Advances on Efficient Vision Transformers
  ☆54Updated 2 years ago
• chenbong / PSS-Net
  ☆17Updated 3 years ago
• megvii-research / SSQL-ECCV2022
  PyTorch implementation of SSQL (Accepted to ECCV2022 oral presentation)
  ☆73Updated 2 years ago
• NVlabs / SMCP
  ☆22Updated 3 years ago
• megvii-research / TPS-CVPR2023
  ☆47Updated 2 years ago
• ziplab / HVT
  [ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"
  ☆33Updated 3 years ago
• OSVAI / NORM
  The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…
  ☆20Updated 2 years ago
• yukimasano / single-img-extrapolating
  Repo for the paper "Extrapolating from a Single Image to a Thousand Classes using Distillation"
  ☆37Updated last year
• enyac-group / supmae
  This is a offical PyTorch/GPU implementation of SupMAE.
  ☆78Updated 3 years ago
• bychen515 / GLiT
  ☆24Updated 3 years ago
• facebookresearch / DeltaCNN
  DeltaCNN End-to-End CNN Inference of Sparse Frame Differences in Videos
  ☆59Updated 2 years ago