Alternatives and similar repositories for prune-then-distill

Users that are interested in prune-then-distill are comparing it to the libraries listed below

• zejiangh / Filter-GaP
  The official PyTorch implementation of CHEX: CHannel EXploration for CNN Model Compression (CVPR 2022). Paper is available at https://ope…
  ☆38Updated 2 years ago
• zyxxmu / White-Box
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 — Carrying out CNN Channel Pruning in a White Box
  ☆18Updated 3 years ago
• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆75Updated last year
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 10 months ago
• zysxmu / IntraQ
  Pytorch implementation of our paper accepted by CVPR 2022 -- IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Sh…
  ☆32Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆146Updated 2 years ago
• kkeono2 / Channel-Pruning-using-Thinet-LASSO-
  ☆14Updated 4 years ago
• lmbxmu / HRankPlus
  An extension version of our paper accepted by CVPR 2020, Oral -- HRank: Filter Pruning using High-Rank Feature Map
  ☆149Updated 4 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆188Updated last year
• lmbxmu / CLR-RNF
  Pytorch implementation of our paper (TNNLS) -- Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters
  ☆12Updated 3 years ago
• zju-vipa / spot-adaptive-pytorch
  ☆24Updated 3 years ago
• selkerdawy / FTWT
  Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction
  ☆11Updated 3 years ago
• VITA-Group / Random_Pruning
  [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…
  ☆73Updated 2 years ago
• DingXiaoH / ResRep
  ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (ICCV 2021)
  ☆295Updated 2 years ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆100Updated 4 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆32Updated 2 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆94Updated 2 years ago
• pprp / PyTorch-CIFAR-Model-Hub
  Implementation of Conv-based and Vit-based networks designed for CIFAR.
  ☆71Updated 2 years ago
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• bytedance / MRECG
  ☆34Updated 2 years ago
• ofsoundof / group_sparsity
  Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression. CVPR2020.
  ☆65Updated 3 years ago
• lippman1125 / channel_pruning_lasso
  channel pruning for accelerating very deep neural networks
  ☆13Updated 4 years ago
• MingSun-Tse / Regularization-Pruning
  [ICLR'21] Neural Pruning via Growing Regularization (PyTorch)
  ☆83Updated 3 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆98Updated last year
• YanjingLi0202 / Q-ViT
  The official implementation of the NeurIPS 2022 paper Q-ViT.
  ☆89Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• dingmyu / HR-NAS
  HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers (CVPR21 Oral)
  ☆142Updated 3 years ago