Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
☆158Dec 28, 2022Updated 3 years ago
Alternatives and similar repositories for DIST_KD
Users that are interested in DIST_KD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Training ImageNet / CIFAR models with sota strategies and fancy techniques such as ViT, KD, Rep, etc.☆87Mar 20, 2024Updated 2 years ago
- Official implementation of paper "Masked Distillation with Receptive Tokens", ICLR 2023.☆72Apr 14, 2023Updated 3 years ago
- 'NKD and USKD' (ICCV 2023) and 'ViTKD' (CVPRW 2024)☆253Oct 10, 2023Updated 3 years ago
- The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distill…☆899Nov 5, 2023Updated 2 years ago
- Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023☆97Jan 24, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Masked Generative Distillation (ECCV 2022)☆243Nov 9, 2022Updated 3 years ago
- The official project website of "NORM: Knowledge Distillation via N-to-One Representation Matching" (The paper of NORM is published in IC…☆20Sep 18, 2023Updated 3 years ago
- [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".☆102Jun 16, 2022Updated 4 years ago
- Official implementation for paper "Relational Surrogate Loss Learning", ICLR 2022☆37Nov 25, 2022Updated 3 years ago
- [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"☆182Dec 3, 2024Updated last year
- Distilling Knowledge via Knowledge Review, CVPR 2021☆276Dec 16, 2022Updated 3 years ago
- Code for 'Multi-level Logit Distillation' (CVPR2023)☆70Sep 23, 2024Updated 2 years ago
- Code for RepNAS☆14Dec 21, 2021Updated 4 years ago
- Deep Structured Instance Graph for Distilling Object Detectors (ICCV 2021)☆35Oct 17, 2021Updated 5 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444☆144Apr 19, 2024Updated 2 years ago
- Codes for ECCV2020 paper "Improving Knowledge Distillation via Category Structure".☆10Mar 15, 2021Updated 5 years ago
- knowledge distillation papers☆767Feb 10, 2023Updated 3 years ago
- [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods☆2,448Oct 16, 2023Updated 3 years ago
- Official code for our ECCV'22 paper "A Fast Knowledge Distillation Framework for Visual Recognition"☆191Apr 29, 2024Updated 2 years ago
- ☆50Sep 24, 2022Updated 4 years ago
- Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization☆582Feb 15, 2023Updated 3 years ago
- Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation☆19Jul 30, 2024Updated 2 years ago
- ☆11Apr 24, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆28 knowledge distillation methods p…☆1,635Oct 27, 2026Updated last week
- [AAAI 2024] Understanding the Role of the Projector in Knowledge Distillation☆20Feb 13, 2024Updated 2 years ago
- Official PyTorch implementation of PS-KD☆90Aug 5, 2022Updated 4 years ago
- Knowledge Distillation Toolbox for Semantic Segmentation☆17Nov 20, 2022Updated 3 years ago
- Code of our Neurips2020 paper "Auto Learning Attention", coming soon☆22Apr 14, 2021Updated 5 years ago
- Video joint denoising and demosaicing with recurrent CNNs - WACV 2023☆13Sep 19, 2023Updated 3 years ago
- ☆34Aug 20, 2023Updated 3 years ago
- ☆59Jun 18, 2021Updated 5 years ago
- [ICML2023] Revisiting Data-Free Knowledge Distillation with Poisoned Teachers☆24Jul 7, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- OpenMMLab Model Compression Toolbox and Benchmark.☆1,689Jun 11, 2024Updated 2 years ago
- ☆28Nov 29, 2023Updated 2 years ago
- ☆17Aug 8, 2024Updated 2 years ago
- Official implementations of CIRKD: Cross-Image Relational Knowledge Distillation for Semantic Segmentation and implementations on Citysca…☆214Aug 29, 2025Updated last year
- [NeurIPS'22] Projector Ensemble Feature Distillation☆30Jan 4, 2024Updated 2 years ago
- Official implementation for paper "LightViT: Towards Light-Weight Convolution-Free Vision Transformers"☆143Jul 26, 2022Updated 4 years ago
- Anytime Dense Prediction with Confidence Adaptivity (ICLR 2022)☆51Aug 23, 2024Updated 2 years ago