Alternatives and similar repositories for dropit

Users that are interested in dropit are comparing it to the libraries listed below

• ziplab / EcoFormer
  [NeurIPS 2022 Spotlight] This is the official PyTorch implementation of "EcoFormer: Energy-Saving Attention with Linear Complexity"
  ☆74Updated 2 years ago
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated last week
• VITA-Group / SViTE
  [NeurIPS'21] "Chasing Sparsity in Vision Transformers: An End-to-End Exploration" by Tianlong Chen, Yu Cheng, Zhe Gan, Lu Yuan, Lei Zhang…
  ☆89Updated last year
• duterscmy / CD-MoE
  Official PyTorch implementation of CD-MOE
  ☆12Updated 5 months ago
• VITA-Group / UVC
  [ICLR 2022] "Unified Vision Transformer Compression" by Shixing Yu*, Tianlong Chen*, Jiayi Shen, Huan Yuan, Jianchao Tan, Sen Yang, Ji Li…
  ☆54Updated last year
• HuangOwen / QAT-ACS
  [TMLR] Official PyTorch implementation of paper "Efficient Quantization-aware Training with Adaptive Coreset Selection"
  ☆34Updated last year
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆34Updated 2 years ago
• NVlabs / SMCP
  ☆22Updated 2 years ago
• OpenGVLab / LLMPrune-BESA
  BESA is a differentiable weight pruning technique for large language models.
  ☆17Updated last year
• GATECH-EIC / SuperTickets
  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
  ☆21Updated 3 years ago
• shawnricecake / search-llm
  [NeurIPS 2024] Search for Efficient LLMs
  ☆15Updated 8 months ago
• VITA-Group / instant_soup
  [ICML2023] Instant Soup Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models. Ajay Jaiswal, Shiwei Liu, Ti…
  ☆11Updated last year
• pprp / CVPR2022-NAS-competition-Track1-3th-solution
  Implementation of PGONAS for CVPR22W and RD-NAS for ICASSP23
  ☆22Updated 2 years ago
• VITA-Group / SFW-Once-for-All-Pruning
  [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…
  ☆32Updated 3 years ago
• HubHop / vit-attention-benchmark
  Benchmarking Attention Mechanism in Vision Transformers.
  ☆18Updated 2 years ago
• VITA-Group / Structure-LTH
  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wa…
  ☆33Updated 2 years ago
• chenbong / PSS-Net
  ☆17Updated 3 years ago
• changlin31 / AutoProg
  (CVPR 2022) Automated Progressive Learning for Efficient Training of Vision Transformers
  ☆25Updated 6 months ago
• yaozhewei / HAP
  ☆43Updated last year
• megvii-research / TPS-CVPR2023
  ☆47Updated 2 years ago
• imagination-research / LCSC
  [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better
  ☆16Updated 7 months ago
• ilur98 / DGQ
  Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM
  ☆14Updated last year
• MAC-AutoML / OMPQ
  ☆26Updated 3 years ago
• VITA-Group / BackRazor_Neurips22
  [Neurips 2022] “ Back Razor: Memory-Efficient Transfer Learning by Self-Sparsified Backpropogation”, Ziyu Jiang*, Xuxi Chen*, Xueqin Huan…
  ☆20Updated 2 years ago
• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆39Updated 2 years ago
• VITA-Group / AsViT
  [ICLR 2022] "As-ViT: Auto-scaling Vision Transformers without Training" by Wuyang Chen, Wei Huang, Xianzhi Du, Xiaodan Song, Zhangyang Wa…
  ☆76Updated 3 years ago
• gatech-sysml / CompOFA
  [ICLR 2021] CompOFA: Compound Once-For-All Networks For Faster Multi-Platform Deployment
  ☆24Updated 2 years ago
• GATECH-EIC / ShiftAddViT
  [NeurIPS 2023] ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
  ☆31Updated last year
• sanagno / adaptively_sparse_attention
  ☆21Updated 2 years ago
• xiezheng-cs / DTQ
  PyTorch implementation of "Deep Transferring Quantization" (ECCV2020)
  ☆18Updated 3 years ago