Alternatives and similar repositories for Knowledge-Distillation-Paper

Users that are interested in Knowledge-Distillation-Paper are comparing it to the libraries listed below

• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆94Updated 2 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 10 months ago
• Jin-Ying / Multi-Level-Logit-Distillation
  Code for 'Multi-level Logit Distillation' (CVPR2023)
  ☆64Updated 8 months ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆117Updated 4 years ago
• snu-mllab / Efficient-Dataset-Condensation
  Official PyTorch implementation of "Dataset Condensation via Efficient Synthetic-Data Parameterization" (ICML'22)
  ☆113Updated last year
• hunto / DIST_KD
  Official implementation of paper "Knowledge Distillation from A Stronger Teacher", NeurIPS 2022
  ☆146Updated 2 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆87Updated 2 years ago
• hunto / DiffKD
  Official implementation for paper "Knowledge Diffusion for Distillation", NeurIPS 2023
  ☆86Updated last year
• AngusDujw / FTD-distillation
  The code of the paper "Minimizing the Accumulated Trajectory Error to Improve Dataset Distillation" (CVPR2023)
  ☆40Updated 2 years ago
• zju-vipa / CMI
  [IJCAI-2021] Contrastive Model Inversion for Data-Free Knowledge Distillation
  ☆72Updated 3 years ago
• Yanqing0327 / DREAM
  Efficient Dataset Distillation by Representative Matching
  ☆113Updated last year
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆32Updated 2 years ago
• lliai / Awesome-Vision-Knowledge-Distillation
  Awesome Knowledge-Distillation for CV
  ☆86Updated last year
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• zhengli97 / CTKD
  [AAAI 2023] Official PyTorch Code for "Curriculum Temperature for Knowledge Distillation"
  ☆174Updated 6 months ago
• yueb17 / DLTH
  ☆30Updated 3 years ago
• zju-vipa / MosaicKD
  [NeurIPS-2021] Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data
  ☆44Updated 2 years ago
• zju-vipa / Fast-Datafree
  [AAAI-2022] Up to 100x Faster Data-free Knowledge Distillation
  ☆70Updated 2 years ago
• VainF / Data-Free-Adversarial-Distillation
  Code and pretrained models for paper: Data-Free Adversarial Distillation
  ☆99Updated 2 years ago
• NUS-HPC-AI-Lab / DATM
  ICLR 2024, Towards Lossless Dataset Distillation via Difficulty-Aligned Trajectory Matching
  ☆101Updated last year
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆176Updated 3 years ago
• UCSC-VLAA / DMAE
  [CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"
  ☆106Updated last year
• lliai / DisWOT-CVPR2023
  ☆26Updated last year
• jaeho-lee / layer-adaptive-sparsity
  In progress.
  ☆64Updated last year
• wonchulSon / DGKD
  Densely Guided Knowledge Distillation using Multiple Teacher Assistants
  ☆11Updated 3 years ago
• MingSun-Tse / Good-DA-in-KD
  [NeurIPS'22] What Makes a "Good" Data Augmentation in Knowledge Distillation -- A Statistical Perspective
  ☆37Updated 2 years ago
• changdaeoh / BlackVIP
  Official implementation for CVPR'23 paper "BlackVIP: Black-Box Visual Prompting for Robust Transfer Learning"
  ☆110Updated last year
• Hao840 / OFAKD
  PyTorch code and checkpoints release for OFA-KD: https://arxiv.org/abs/2310.19444
  ☆125Updated last year
• hikvision-research / SAViT
  ☆12Updated last year
• da2so / Zero-shot_Knowledge_Distillation_Pytorch
  ZSKD with PyTorch
  ☆31Updated last year