Alternatives and similar repositories for prune-then-distill:

Users that are interested in prune-then-distill are comparing it to the libraries listed below

• zejiangh / Filter-GaP
  The official PyTorch implementation of CHEX: CHannel EXploration for CNN Model Compression (CVPR 2022). Paper is available at https://ope…
  ☆37Updated 2 years ago
• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆75Updated last year
• lippman1125 / channel_pruning_lasso
  channel pruning for accelerating very deep neural networks
  ☆13Updated 4 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆74Updated 7 months ago
• zyxxmu / White-Box
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 — Carrying out CNN Channel Pruning in a White Box
  ☆18Updated 3 years ago
• lliai / DisWOT-CVPR2023
  ☆25Updated last year
• lmbxmu / CLR-RNF
  Pytorch implementation of our paper (TNNLS) -- Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters
  ☆12Updated 3 years ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated 11 months ago
• zju-vipa / spot-adaptive-pytorch
  ☆22Updated 2 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago
• pprp / PyTorch-CIFAR-Model-Hub
  Implementation of Conv-based and Vit-based networks designed for CIFAR.
  ☆72Updated 2 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆186Updated 10 months ago
• VITA-Group / Random_Pruning
  [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…
  ☆73Updated 2 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆97Updated 10 months ago
• MingSun-Tse / Regularization-Pruning
  [ICLR'21] Neural Pruning via Growing Regularization (PyTorch)
  ☆83Updated 3 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆92Updated 2 years ago
• kkeono2 / Channel-Pruning-using-Thinet-LASSO-
  ☆14Updated 4 years ago
• zysxmu / IntraQ
  Pytorch implementation of our paper accepted by CVPR 2022 -- IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Sh…
  ☆31Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆140Updated 2 years ago
• zhouzaida / channel-distillation
  PyTorch implementation for Channel Distillation
  ☆100Updated 4 years ago
• Jangho-Kim / Factor-Transfer-pytorch
  Paraphrasing Complex Network: Network Compression via Factor Transfer Code (NeurIPS 2018)
  ☆20Updated 4 years ago
• lmbxmu / HRankPlus
  An extension version of our paper accepted by CVPR 2020, Oral -- HRank: Filter Pruning using High-Rank Feature Map
  ☆149Updated 3 years ago
• changlin31 / DS-Net
  (CVPR 2021, Oral) Dynamic Slimmable Network
  ☆229Updated 3 years ago
• hunto / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆68Updated last year
• ofsoundof / group_sparsity
  Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression. CVPR2020.
  ☆63Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• hunto / DyRep
  Official implementation for paper "DyRep: Bootstrapping Training with Dynamic Re-parameterization", CVPR 2022
  ☆44Updated 2 years ago
• selkerdawy / FTWT
  Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction
  ☆10Updated 2 years ago
• DingXiaoH / ResRep
  ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (ICCV 2021)
  ☆294Updated 2 years ago
• lliai / Awesome-Vision-Knowledge-Distillation
  Awesome Knowledge-Distillation for CV
  ☆80Updated 10 months ago