Alternatives and similar repositories for FitNets

Users that are interested in FitNets are comparing it to the libraries listed below

• szagoruyko / attention-transfer

  View on GitHub
  Improving Convolutional Networks via Attention Transfer (ICLR 2017)
  ☆1,463Jul 11, 2018Updated 7 years ago
• TuSimple / neuron-selectivity-transfer

  View on GitHub
  ☆137Oct 22, 2018Updated 7 years ago
• imirzadeh / Teacher-Assistant-Knowledge-Distillation

  View on GitHub
  Using Teacher Assistants to Improve Knowledge Distillation: https://arxiv.org/pdf/1902.03393.pdf
  ☆264Oct 3, 2019Updated 6 years ago
• bhheo / AB_distillation

  View on GitHub
  Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)
  ☆106Sep 9, 2019Updated 6 years ago
• chengshengchan / model_compression

  View on GitHub
  Implementation of model compression with knowledge distilling method.
  ☆342Jan 3, 2017Updated 9 years ago
• dkozlov / awesome-knowledge-distillation

  View on GitHub
  Awesome Knowledge Distillation
  ☆3,811Dec 25, 2025Updated last month
• luyongxi / az-net

  View on GitHub
  Object detection using AZ-Net
  ☆44Jan 30, 2017Updated 9 years ago
• haitongli / knowledge-distillation-pytorch

  View on GitHub
  A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility
  ☆1,981Mar 25, 2023Updated 2 years ago
• yiwenguo / Dynamic-Network-Surgery

  View on GitHub
  Caffe implementation for dynamic network surgery.
  ☆189Aug 15, 2017Updated 8 years ago
• lenscloth / RKD

  View on GitHub
  Official pytorch Implementation of Relational Knowledge Distillation, CVPR 2019
  ☆414May 17, 2021Updated 4 years ago
• tejasgodambe / knowledge-distillation

  View on GitHub
  Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN
  ☆29May 8, 2017Updated 8 years ago
• xiaolonw / fast-rcnn-distillation

  View on GitHub
  ☆17May 31, 2016Updated 9 years ago
• yuanli2333 / Teacher-free-Knowledge-Distillation

  View on GitHub
  Knowledge Distillation: CVPR2020 Oral, Revisiting Knowledge Distillation via Label Smoothing Regularization
  ☆585Feb 15, 2023Updated 3 years ago
• zhougr1993 / Rocket-Launching

  View on GitHub
  A universal and efficient framework for training well-performing light net
  ☆125Aug 30, 2017Updated 8 years ago
• lhyfst / knowledge-distillation-papers

  View on GitHub
  knowledge distillation papers
  ☆767Feb 10, 2023Updated 3 years ago
• ThomasMiconi / DiffRNN

  View on GitHub
  RNN with differentiable structure (number of neurons)
  ☆22Aug 1, 2016Updated 9 years ago
• masabdi / multi-resnet

  View on GitHub
  Multi-Residual Networks
  ☆23Nov 25, 2016Updated 9 years ago
• EthanZhangYC / OD-cheap-convolution

  View on GitHub
  PyTorch implementation for OD-cheap-convolution.
  ☆20Sep 29, 2019Updated 6 years ago
• allenai / XNOR-Net

  View on GitHub
  ImageNet classification using binary Convolutional Neural Networks
  ☆866Dec 5, 2017Updated 8 years ago
• sseung0703 / KD_methods_with_TF

  View on GitHub
  Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)
  ☆265Nov 21, 2019Updated 6 years ago
• antspy / quantized_distillation

  View on GitHub
  Implements quantized distillation. Code for our paper "Model compression via distillation and quantization"
  ☆336Jul 25, 2024Updated last year
• ethanhe42 / channel-pruning

  View on GitHub
  Channel Pruning for Accelerating Very Deep Neural Networks (ICCV'17)
  ☆1,086May 2, 2024Updated last year
• vadimkantorov / contextlocnet

  View on GitHub
  ContextLocNet: Context-aware Deep Network Models for Weakly Supervised Localization (ECCV 2016)
  ☆87Apr 6, 2017Updated 8 years ago
• HolmesShuan / Dynamic-Network-Surgery-Caffe-Reimplementation

  View on GitHub
  Caffe re-implementation of dynamic network surgery.
  ☆18Jun 15, 2018Updated 7 years ago
• MatthieuCourbariaux / BinaryNet

  View on GitHub
  Training Deep Neural Networks with Weights and Activations Constrained to +1 or -1
  ☆1,064Nov 28, 2018Updated 7 years ago
• ynahshan / nn-quantization-pytorch

  View on GitHub
  ☆57Dec 8, 2020Updated 5 years ago
• AberHu / Knowledge-Distillation-Zoo

  View on GitHub
  Pytorch implementation of various Knowledge Distillation (KD) methods.
  ☆1,742Nov 25, 2021Updated 4 years ago
• forjiuzhou / Spherical-Knowledge-Distillation

  View on GitHub
  ☆34Aug 20, 2023Updated 2 years ago
• LTH14 / FSKD

  View on GitHub
  ☆31Jun 18, 2020Updated 5 years ago
• zzzxxxttt / pytorch_simple_DARTS

  View on GitHub
  A simple pytorch implementation of Differentiable Architecture Search (DARTS)
  ☆22Aug 27, 2019Updated 6 years ago
• YingZhangDUT / Deep-Mutual-Learning

  View on GitHub
  TensorFlow Implementation of Deep Mutual Learning
  ☆326Apr 10, 2018Updated 7 years ago
• bharath272 / sds

  View on GitHub
  Code for SDS
  ☆58Sep 8, 2015Updated 10 years ago
• yufanLIU / IRG

  View on GitHub
  Source code for 'Knowledge Distillation via Instance Relationship Graph'
  ☆30Jun 13, 2019Updated 6 years ago
• FLHonker / Awesome-Knowledge-Distillation

  View on GitHub
  Awesome Knowledge-Distillation. 分类整理的知识蒸馏paper(2014-2021)。
  ☆2,654May 30, 2023Updated 2 years ago
• daodaofr / caffe-re-id

  View on GitHub
  ☆12Oct 8, 2016Updated 9 years ago
• AaronHeee / MEAL

  View on GitHub
  Official Implementation of MEAL: Multi-Model Ensemble via Adversarial Learning on AAAI 2019
  ☆177Feb 20, 2020Updated 5 years ago
• HobbitLong / RepDistiller

  View on GitHub
  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
  ☆2,426Oct 16, 2023Updated 2 years ago
• JIA-Lab-research / ReviewKD

  View on GitHub
  Distilling Knowledge via Knowledge Review, CVPR 2021
  ☆280Dec 16, 2022Updated 3 years ago
• sseung0703 / SSKD_SVD

  View on GitHub
  ☆51Aug 8, 2019Updated 6 years ago