shriramsb / Distilling-the-Knowledge-in-a-Neural-Network

Related projects: ⓘ

• JoonyoungYi / KD-pytorch
  PyTorch implementation of "Distilling the Knowledge in a Neural Network"
  ☆66Updated 2 years ago
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆47Updated last year
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆31Updated last month
• da2so / Data-Free_Network_Quantization_With_Adversarial_Knowledge_Distillation
  Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch
  ☆29Updated 3 years ago
• jhoon-oh / kd_data
  IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"
  ☆38Updated last year
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆72Updated last year
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆152Updated 2 years ago
• chenhang98 / mobileNet-v2_cifar10
  a pytorch implement of mobileNet v2 on cifar10
  ☆60Updated last year
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 4 years ago
• AnTuo1998 / AE-KD
  ☆26Updated 3 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆111Updated 3 years ago
• meet-minimalist / TinyImageNet-Benchmarks
  Benchmarking various Computer Vision models on TinyImageNet Dataset
  ☆24Updated last year
• wangleiofficial / label-smoothing-pytorch
  label smoothing PyTorch implementation
  ☆30Updated 3 years ago
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆107Updated 4 years ago
• zju-pi / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆69Updated 3 weeks ago
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆117Updated 3 years ago
• VITA-Group / Nasty-Teacher
  [ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Che…
  ☆80Updated 2 years ago
• sseung0703 / Variational_Information_Distillation
  Reproducing VID in CVPR2019 (on working)
  ☆20Updated 4 years ago
• yueb17 / DLTH
  ☆29Updated 2 years ago
• seominseok0429 / label-smoothing-visualization-pytorch
  When Does Label Smoothing Help?_pytorch_implementationimp
  ☆124Updated 4 years ago
• Jangho-Kim / FFL-pytorch
  Feature Fusion for Online Mutual Knowledge Distillation Code
  ☆24Updated 4 years ago
• varun19299 / rigl-reproducibility
  Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020
  ☆26Updated 2 years ago
• Meta-knowledge-Lab / DLB
  Code for Paper "Self-Distillation from the Last Mini-Batch for Consistency Regularization"
  ☆41Updated last year
• xuguodong03 / SSKD
  [ECCV2020] Knowledge Distillation Meets Self-Supervision
  ☆233Updated last year
• bhheo / BSS_distillation
  Knowledge Distillation with Adversarial Samples Supporting Decision Boundary (AAAI 2019)
  ☆70Updated 5 years ago
• GuyHacohen / curriculum_learning
  Code implementing the experiments described in the paper "On The Power of Curriculum Learning in Training Deep Networks" by Hacohen & Wei…
  ☆104Updated 4 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆156Updated 3 years ago
• bolianchen / Data-Free-Learning-of-Student-Networks
  ☆20Updated 3 years ago
• VITA-Group / SFW-Once-for-All-Pruning
  [ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, T…
  ☆29Updated 2 years ago
• VainF / Data-Free-Adversarial-Distillation
  Code and pretrained models for paper: Data-Free Adversarial Distillation
  ☆95Updated last year