Alternatives and similar repositories for Distilling-the-Knowledge-in-a-Neural-Network

Users that are interested in Distilling-the-Knowledge-in-a-Neural-Network are comparing it to the libraries listed below

• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆78Updated 2 months ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆117Updated 4 years ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆176Updated 3 years ago
• JoonyoungYi / KD-pytorch
  PyTorch implementation of "Distilling the Knowledge in a Neural Network"
  ☆67Updated 3 years ago
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆126Updated 4 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆48Updated 2 years ago
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆74Updated last year
• AnTuo1998 / AE-KD
  ☆27Updated 4 years ago
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆107Updated 4 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 5 years ago
• Rorozhl / CA-MKD
  This is the implementation for the ICASSP-2022 paper (Confidence-Aware Multi-Teacher Knowledge Distillation).
  ☆58Updated 3 years ago
• sseung0703 / Variational_Information_Distillation
  Reproducing VID in CVPR2019 (on working)
  ☆20Updated 5 years ago
• DefangChen / SimKD
  [CVPR-2022] Official implementation for "Knowledge Distillation with the Reused Teacher Classifier".
  ☆95Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆40Updated 2 years ago
• da2so / Data-Free_Network_Quantization_With_Adversarial_Knowledge_Distillation
  Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch
  ☆29Updated 3 years ago
• zju-vipa / Fast-Datafree
  [AAAI-2022] Up to 100x Faster Data-free Knowledge Distillation
  ☆70Updated 2 years ago
• Jangho-Kim / FFL-pytorch
  Feature Fusion for Online Mutual Knowledge Distillation Code
  ☆26Updated 4 years ago
• jhoon-oh / kd_data
  IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"
  ☆41Updated 2 years ago
• Rorozhl / MMKD
  This is the implementation for the ICME-2023 paper (Adaptive Multi-Teacher Knowledge Distillation with Meta-Learning).
  ☆25Updated 2 years ago
• Cydia2018 / ViT-cifar10-pruning
  Vision Transformer Pruning
  ☆57Updated 3 years ago
• DefangChen / SemCKD
  [AAAI-2021, TKDE-2023] Official implementation for "Cross-Layer Distillation with Semantic Calibration".
  ☆75Updated 10 months ago
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆32Updated 10 months ago
• meet-minimalist / TinyImageNet-Benchmarks
  Benchmarking various Computer Vision models on TinyImageNet Dataset
  ☆29Updated 2 years ago
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆237Updated 2 years ago
• zju-vipa / CMI
  [IJCAI-2021] Contrastive Model Inversion for Data-Free Knowledge Distillation
  ☆72Updated 3 years ago
• Kthyeon / FINE_official
  NeurIPS 2021, "Fine Samples for Learning with Noisy Labels"
  ☆39Updated 3 years ago
• lgcnsai / PS-KD-Pytorch
  Official PyTorch implementation of PS-KD
  ☆87Updated 2 years ago
• forjiuzhou / Spherical-Knowledge-Distillation
  ☆34Updated last year
• VainF / Data-Free-Adversarial-Distillation
  Code and pretrained models for paper: Data-Free Adversarial Distillation
  ☆99Updated 2 years ago
• da2so / Zero-shot_Knowledge_Distillation_Pytorch
  ZSKD with PyTorch
  ☆31Updated last year