Alternatives and similar repositories for prune-then-distill:

Users that are interested in prune-then-distill are comparing it to the libraries listed below

• zejiangh / Filter-GaP
  The official PyTorch implementation of CHEX: CHannel EXploration for CNN Model Compression (CVPR 2022). Paper is available at https://ope…
  ☆37Updated 2 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 8 months ago
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• zyxxmu / White-Box
  Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 — Carrying out CNN Channel Pruning in a White Box
  ☆18Updated 3 years ago
• Hao840 / vanillaKD
  PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781
  ☆74Updated last year
• lmbxmu / CLR-RNF
  Pytorch implementation of our paper (TNNLS) -- Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters
  ☆12Updated 3 years ago
• hunto / image_classification_sota
  Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.
  ☆82Updated last year
• MingSun-Tse / Regularization-Pruning
  [ICLR'21] Neural Pruning via Growing Regularization (PyTorch)
  ☆83Updated 3 years ago
• lippman1125 / channel_pruning_lasso
  channel pruning for accelerating very deep neural networks
  ☆13Updated 4 years ago
• szq0214 / S2-BNN
  S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)
  ☆64Updated 3 years ago
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆143Updated 2 years ago
• winycg / Self-KD-Lib
  [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…
  ☆106Updated 2 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• szq0214 / FKD
  Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"
  ☆186Updated 11 months ago
• kkeono2 / Channel-Pruning-using-Thinet-LASSO-
  ☆14Updated 4 years ago
• pprp / PyTorch-CIFAR-Model-Hub
  Implementation of Conv-based and Vit-based networks designed for CIFAR.
  ☆71Updated 2 years ago
• selkerdawy / FTWT
  Fire Together Wire Together: A Dynamic Pruning Approach with Self-Supervised Mask Prediction
  ☆10Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• lmbxmu / HRankPlus
  An extension version of our paper accepted by CVPR 2020, Oral -- HRank: Filter Pruning using High-Rank Feature Map
  ☆149Updated 3 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆92Updated 2 years ago
• hunto / MasKD
  Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.
  ☆69Updated 2 years ago
• zju-vipa / spot-adaptive-pytorch
  ☆23Updated 2 years ago
• VITA-Group / Random_Pruning
  [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…
  ☆73Updated 2 years ago
• zysxmu / IntraQ
  Pytorch implementation of our paper accepted by CVPR 2022 -- IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Sh…
  ☆31Updated 3 years ago
• MingiJi / FRSKD
  Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)
  ☆98Updated 11 months ago
• jaeho-lee / layer-adaptive-sparsity
  In progress.
  ☆63Updated last year
• ziplab / SPViT
  [TPAMI 2024] This is the official repository for our paper: ''Pruning Self-attentions into Convolutional Layers in Single Path''.
  ☆112Updated last year
• Daner-Wang / VTC-LFC
  ☆26Updated 2 years ago
• ofsoundof / group_sparsity
  Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression. CVPR2020.
  ☆63Updated 3 years ago
• zysxmu / FDDA
  Pytorch implementation of our paper accepted by ECCV 2022-- Fine-grained Data Distribution Alignment for Post-Training Quantization
  ☆14Updated 2 years ago