Alternatives and similar repositories for Distilling-the-Knowledge-in-a-Neural-Network

Users that are interested in Distilling-the-Knowledge-in-a-Neural-Network are comparing it to the libraries listed below

• ra1ph2 / Vision-Transformer
  Implementation of Vision Transformer from scratch and performance compared to standard CNNs (ResNets) and pre-trained ViT on CIFAR10 and …
  ☆113Updated last year
• shaoeric / Online-Knowledge-Distillation-via-Collaborative-Learning
  A simple reimplement Online Knowledge Distillation via Collaborative Learning with pytorch
  ☆49Updated 2 years ago
• luanyunteng / pytorch-be-your-own-teacher
  A pytorch implementation of paper 'Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillation', …
  ☆181Updated 3 years ago
• clovaai / attention-feature-distillation
  Official implementation for (Show, Attend and Distill: Knowledge Distillation via Attention-based Feature Matching, AAAI-2021)
  ☆119Updated 4 years ago
• DennisHanyuanXu / Tiny-ImageNet
  Image classification on Tiny ImageNet
  ☆74Updated last year
• yuanli2333 / CKA-Centered-Kernel-Alignment
  Reproduce CKA: Similarity of Neural Network Representations Revisited
  ☆311Updated 5 years ago
• Rorozhl / CA-MKD
  This is the implementation for the ICASSP-2022 paper (Confidence-Aware Multi-Teacher Knowledge Distillation).
  ☆61Updated 3 years ago
• da2so / Data-Free_Network_Quantization_With_Adversarial_Knowledge_Distillation
  Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch
  ☆30Updated 4 years ago
• tjmoon0104 / pytorch-tiny-imagenet
  pytorch-tiny-imagenet
  ☆181Updated this week
• chihhuiho / CLAE
  Implementation of Contrastive Learning with Adversarial Examples
  ☆29Updated 4 years ago
• DefangChen / Knowledge-Distillation-Paper
  This resposity maintains a collection of important papers on knowledge distillation (awesome-knowledge-distillation)).
  ☆80Updated 6 months ago
• meet-minimalist / TinyImageNet-Benchmarks
  Benchmarking various Computer Vision models on TinyImageNet Dataset
  ☆33Updated 2 years ago
• ArchipLab-LinfengZhang / pytorch-self-distillation-final
  ☆127Updated 4 years ago
• JoonyoungYi / KD-pytorch
  PyTorch implementation of "Distilling the Knowledge in a Neural Network"
  ☆66Updated 3 years ago
• DefangChen / OKDDip
  [AAAI-2020] Official implementation for "Online Knowledge Distillation with Diverse Peers".
  ☆75Updated 2 years ago
• varun19299 / rigl-reproducibility
  Reproducing RigL (ICML 2020) as a part of ML Reproducibility Challenge 2020
  ☆28Updated 3 years ago
• chxy95 / Deep-Mutual-Learning
  An unofficial implementation of 《Deep Mutual Learning》 by Pytorch to do classification on cifar100.
  ☆166Updated 4 years ago
• zju-vipa / Fast-Datafree
  [AAAI-2022] Up to 100x Faster Data-free Knowledge Distillation
  ☆73Updated 2 years ago
• alinlab / cs-kd
  Regularizing Class-wise Predictions via Self-knowledge Distillation (CVPR 2020)
  ☆109Updated 5 years ago
• danielchyeh / ImageNet-100-Pytorch
  (Pytorch) Training ResNets on ImageNet-100 data
  ☆63Updated 3 years ago
• FLHonker / AMTML-KD-code
  AMTML-KD: Adaptive Multi-teacher Multi-level Knowledge Distillation
  ☆61Updated 4 years ago
• Jangho-Kim / FFL-pytorch
  Feature Fusion for Online Mutual Knowledge Distillation Code
  ☆26Updated 5 years ago
• SonyResearch / MocoSFL
  Official Repository for MocoSFL (accepted by ICLR '23, notable 5%)
  ☆52Updated 2 years ago
• Leebh-kor / Simple-code-Visualizing-the-Loss-Landscape-of-Neural-Nets
  Reimplmentation of Visualizing the Loss Landscape of Neural Nets with PyTorch 1.8
  ☆29Updated 2 years ago
• tjmoon0104 / Tiny-ImageNet-Classifier
  Tiny-ImageNet Classifier using Pytorch
  ☆91Updated 6 years ago
• tanimutomo / cifar10-c-eval
  Testing a model performance for CIFAR10-C
  ☆36Updated 5 years ago
• AnTuo1998 / AE-KD
  ☆27Updated 4 years ago
• seominseok0429 / label-smoothing-visualization-pytorch
  When Does Label Smoothing Help?_pytorch_implementationimp
  ☆126Updated 5 years ago
• Kthyeon / FINE_official
  NeurIPS 2021, "Fine Samples for Learning with Noisy Labels"
  ☆39Updated 3 years ago
• VITA-Group / Nasty-Teacher
  [ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Che…
  ☆82Updated 3 years ago