Alternatives and similar repositories for EcoFormer

Users that are interested in EcoFormer are comparing it to the libraries listed below

• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• ziplab / Mesa
  This is the official PyTorch implementation for "Mesa: A Memory-saving Training Framework for Transformers".
  ☆120Updated 3 years ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆53Updated last year
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 years ago
• VITA-Group / SViTE
  [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…
  ☆90Updated last year
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆31Updated 2 years ago
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated 3 months ago
• ziplab / SAQ
  This is the official PyTorch implementation for "Sharpness-aware Quantization for Deep Neural Networks".
  ☆43Updated 3 years ago
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆33Updated 2 years ago
• BeSpontaneous / Scala-pytorch
  Scala(NeurIPS 2024)
  ☆10Updated 6 months ago
• ziplab / HVT
  [ICCV 2021] Official implementation of "Scalable Vision Transformers with Hierarchical Pooling"
  ☆33Updated 3 years ago
• GATECH-EIC / Castling-ViT
  [CVPR 2023] Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
  ☆30Updated last year
• xiusu / ViTAS
  Code for ViTAS_Vision Transformer Architecture Search
  ☆50Updated 3 years ago
• facebookresearch / NASViT
  code for NASViT
  ☆67Updated 3 years ago
• okojoalg / raft-mlp
  ☆25Updated 3 years ago
• facebookresearch / DepthShrinker
  [ICML 2022] "DepthShrinker: A New Compression Paradigm Towards Boosting Real-Hardware Efficiency of Compact Neural Networks", by Yonggan …
  ☆71Updated 2 years ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆18Updated 2 years ago
• fawazsammani / awesome-mlp-mixer
  Transformers w/o Attention, based fully on MLPs
  ☆93Updated last year
• VITA-Group / ViT-Anti-Oversmoothing
  [ICLR 2022] "Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice" by Peihao Wang, Wen…
  ☆80Updated last year
• megvii-research / SSQL-ECCV2022
  PyTorch implementation of SSQL (Accepted to ECCV2022 oral presentation)
  ☆73Updated 2 years ago
• bellymonster / Weighted-Soft-Label-Distillation
  ☆57Updated 4 years ago
• szq0214 / SReT
  Official PyTorch implementation of our ECCV 2022 paper "Sliced Recursive Transformer"
  ☆65Updated 2 years ago
• GATECH-EIC / ShiftAddNAS
  [ICML 2022] ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks
  ☆16Updated 3 years ago
• lmbxmu / SuperViT
  Official Pytorch implementation of Super Vision Transformer (IJCV)
  ☆43Updated last year
• enyac-group / supmae
  This is a offical PyTorch/GPU implementation of SupMAE.
  ☆78Updated 2 years ago
• bychen515 / GLiT
  ☆24Updated 3 years ago
• jinqixiao / ComCAT
  ☆16Updated last year
• VITA-Group / BackRazor_Neurips22
  [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…
  ☆19Updated 2 years ago
• chenbong / PSS-Net
  ☆17Updated 2 years ago
• naver-ai / augsub
  [CVPR 2025] Official PyTorch implementation of MaskSub "Masking meets Supervision: A Strong Learning Alliance"
  ☆42Updated 3 months ago