ososos888 / prune-then-distillLinks
☆47Updated 2 years ago
Alternatives and similar repositories for prune-then-distill
Users that are interested in prune-then-distill are comparing it to the libraries listed below
Sorting:
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆75Updated last year
- [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".☆75Updated 11 months ago
- Pytorch implementation of our paper accepted by IEEE TNNLS, 2022 — Carrying out CNN Channel Pruning in a White Box☆18Updated 3 years ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆147Updated 2 years ago
- ☆24Updated 3 years ago
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆82Updated last year
- Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"☆188Updated last year
- [ECCV-2022] Official implementation of MixSKD: Self-Knowledge Distillation from Mixup for Image Recognition && Pytorch Implementations of…☆108Updated 2 years ago
- Official implementation for (Refine Myself by Teaching Myself : Feature Refinement via Self-Knowledge Distillation, CVPR-2021)☆100Updated last year
- Implementation of Conv-based and Vit-based networks designed for CIFAR.☆70Updated 2 years ago
- The official PyTorch implementation of CHEX: CHannel EXploration for CNN Model Compression (CVPR 2022). Paper is available at https://ope…☆38Updated 3 years ago
- Distilling Knowledge via Knowledge Review, CVPR 2021☆273Updated 2 years ago
- PyTorch implementation for Channel Distillation☆102Updated 5 years ago
- Official implementation for paper "DyRep: Bootstrapping Training with Dynamic Re-parameterization", CVPR 2022☆43Updated 3 years ago
- channel pruning for accelerating very deep neural networks☆13Updated 4 years ago
- Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.☆69Updated 2 years ago
- Awesome Knowledge-Distillation for CV☆88Updated last year
- ☆26Updated last year
- An extension version of our paper accepted by CVPR 2020, Oral -- HRank: Filter Pruning using High-Rank Feature Map☆151Updated 4 years ago
- [ICLR 2022] The Unreasonable Effectiveness of Random Pruning: Return of the Most Naive Baseline for Sparse Training by Shiwei Liu, Tianlo…☆73Updated 2 years ago
- S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)☆64Updated 3 years ago
- ResRep: Lossless CNN Pruning via Decoupling Remembering and Forgetting (ICCV 2021)☆296Updated 2 years ago
- [CVPR 2021]OPANAS: One-Shot Path Aggregation Network Architecture Search for Object Detection☆45Updated last year
- RM Operation can equivalently convert ResNet to VGG, which is better for pruning; and can help RepVGG perform better when the depth is la…☆211Updated 2 years ago
- Distilling Object Detectors with Feature Richness☆44Updated 3 years ago
- Group Sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression. CVPR2020.☆65Updated 3 years ago
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆98Updated 3 years ago
- ☆14Updated 4 years ago
- HR-NAS: Searching Efficient High-Resolution Neural Architectures with Lightweight Transformers (CVPR21 Oral)☆142Updated 4 years ago
- Pytorch implementation of our paper (TNNLS) -- Pruning Networks with Cross-Layer Ranking & k-Reciprocal Nearest Filters☆12Updated 3 years ago