CVPR 2023, Class Attention Transfer Based Knowledge Distillation
☆46Jun 13, 2023Updated 2 years ago
Alternatives and similar repositories for CAT-KD
Users that are interested in CAT-KD are comparing it to the libraries listed below
Sorting:
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆71Sep 23, 2024Updated last year
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 2 years ago
- [ICML2024] DetKDS: Knowledge Distillation Search for Object Detectors☆19Jul 11, 2024Updated last year
- Official implementation for "Knowledge Distillation with Refined Logits".☆22Aug 26, 2024Updated last year
- ☆29Nov 29, 2023Updated 2 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆890Nov 5, 2023Updated 2 years ago
- Distilling Knowledge via Knowledge Review, CVPR 2021☆280Dec 16, 2022Updated 3 years ago
- ☆10Jul 5, 2019Updated 6 years ago
- ☆14Dec 14, 2023Updated 2 years ago
- ACCV2022 Source Code of paper "Feature Decoupled Knowledge Distillation via Spatial Pyramid Pooling"☆12Jul 5, 2023Updated 2 years ago
- ☆10May 9, 2019Updated 6 years ago
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆136Apr 19, 2024Updated last year
- [ACL'22] Training-free Neural Architecture Search for RNNs and Transformers☆14May 26, 2024Updated last year
- PyTorch implementation of "Learning from Students: Online Contrastive Distillation Network for General Continual Learning" (IJCAI 2022)☆11Dec 29, 2022Updated 3 years ago
- Codes for DATA: Differentiable ArchiTecture Approximation.☆11Jul 22, 2021Updated 4 years ago
- Official implementation of the paper "Function-Consistent Feature Distillation" (ICLR 2023)☆30Jul 5, 2023Updated 2 years ago
- [ICME-2022] Official implementations of Localizing Semantic Patches for Accelerating Image Classification☆16Jul 1, 2022Updated 3 years ago
- Source Code for "Dual-Level Knowledge Distillation via Knowledge Alignment and Correlation", TNNLS, https://ieeexplore.ieee.org/abstract/…☆12Dec 21, 2022Updated 3 years ago
- [CVPR 2024 Highlight] Logit Standardization in Knowledge Distillation☆390Oct 9, 2024Updated last year
- [ICCV 2023] DataDAM: Efficient Dataset Distillation with Attention Matching☆34Jun 20, 2024Updated last year
- ☆10Jul 25, 2024Updated last year
- ☆15May 28, 2024Updated last year
- ICML2019 Accepted Paper. Overcoming Multi-Model Forgetting☆14Jun 5, 2019Updated 6 years ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆242Oct 10, 2023Updated 2 years ago
- Data-free knowledge distillation using Gaussian noise (NeurIPS paper)☆15Mar 24, 2023Updated 2 years ago
- Benchmarks for Macro Neural Architecture Search; used and described in the paper "Local Search is a Remarkably Strong Baseline for Neural…☆12Jul 25, 2024Updated last year
- Auto-Prox-AAAI24☆14Apr 30, 2024Updated last year
- ☆15Aug 25, 2020Updated 5 years ago
- ☆20Aug 16, 2021Updated 4 years ago
- Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022☆155Dec 28, 2022Updated 3 years ago
- ☆17Jul 10, 2022Updated 3 years ago
- PyTorch implementation for OD-cheap-convolution.☆20Sep 29, 2019Updated 6 years ago
- ☆20Feb 26, 2021Updated 5 years ago
- ☆19May 11, 2021Updated 4 years ago
- The official PyTorch implementation of CHEX: CHannel EXploration for CNN Model Compression (CVPR 2022). Paper is available at https://ope…☆38Jul 2, 2022Updated 3 years ago
- The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)☆40Mar 25, 2023Updated 2 years ago
- PyTorch code and checkpoints release for VanillaKD: https://arxiv.org/abs/2305.15781☆76Nov 21, 2023Updated 2 years ago
- Prioritize Alignment in Dataset Distillation☆21Dec 3, 2024Updated last year
- [NeurIPS 2019] E2-Train: Training State-of-the-art CNNs with Over 80% Less Energy☆21Nov 18, 2019Updated 6 years ago