da2so / Zero-shot_Knowledge_Distillation_Pytorch

Related projects: ⓘ

• da2so / Data-Free_Network_Quantization_With_Adversarial_Knowledge_Distillation
  Data-Free Network Quantization With Adversarial Knowledge Distillation PyTorch
  ☆29Updated 3 years ago
• Piyush-555 / GaussianDistillation
  Data-free knowledge distillation using Gaussian noise (NeurIPS paper)
  ☆15Updated last year
• VITA-Group / Nasty-Teacher
  [ICLR 2021 Spotlight Oral] "Undistillable: Making A Nasty Teacher That CANNOT teach students", Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Che…
  ☆80Updated 2 years ago
• mary-phuong / multiexit-distillation
  ☆22Updated 4 years ago
• MingSun-Tse / Smile-Pruning
  A generic code base for neural network pruning, especially for pruning at initialization.
  ☆30Updated 2 years ago
• AnTuo1998 / AE-KD
  ☆26Updated 3 years ago
• ondrejbohdal / label-distillation
  Official PyTorch implementation of “Flexible Dataset Distillation: Learn Labels Instead of Images”
  ☆41Updated 3 years ago
• boone891214 / MEST
  [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…
  ☆17Updated 2 years ago
• VITA-Group / CV_LTH_Pre-training
  [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jon…
  ☆67Updated last year
• dwang181 / active-mixup
  Code for Active Mixup in 2020 CVPR
  ☆22Updated 2 years ago
• selkerdawy / filter-vs-layer-pruning
  ☆10Updated 3 years ago
• jhoon-oh / kd_data
  IJCAI 2021, "Comparing Kullback-Leibler Divergence and Mean Squared Error Loss in Knowledge Distillation"
  ☆38Updated last year
• VITA-Group / Lifelong-Learning-LTH
  [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, S…
  ☆22Updated 2 years ago
• friendshipkim / neuron-merging
  Neuron Merging: Compensating for Pruned Neurons (NeurIPS 2020)
  ☆41Updated 3 years ago
• deeplearning-wisc / MOOD
  Code for CVPR2021 paper: MOOD: Multi-level Out-of-distribution Detection
  ☆38Updated last year
• yukimasano / single-img-extrapolating
  Repo for the paper "Extrapolating from a Single Image to a Thousand Classes using Distillation"
  ☆37Updated 2 months ago
• bolianchen / Data-Free-Learning-of-Student-Networks
  ☆20Updated 3 years ago
• snu-mllab / Efficient-Dataset-Condensation
  Official PyTorch implementation of "Dataset Condensation via Efficient Synthetic-Data Parameterization" (ICML'22)
  ☆105Updated 11 months ago
• seshuad / IMagenet
  Tiny Imagenet Visual Recognition Challenge
  ☆32Updated 6 years ago
• xiangning-chen / DrNAS
  Code for our ICLR'2021 paper "DrNAS: Dirichlet Neural Architecture Search"
  ☆42Updated 3 years ago
• junjieliu2910 / DynamicSparseTraining
  [ICLR-2020] Dynamic Sparse Training: Find Efficient Sparse Network From Scratch With Trainable Masked Layers.
  ☆31Updated 4 years ago
• enyac-group / Joslim
  Official codebase for our paper "Joslim: Joint Widths and Weights Optimization for Slimmable Neural Networks"
  ☆12Updated 3 years ago
• yueb17 / DLTH
  ☆29Updated 2 years ago
• salesforce / ensemble-of-averages
  ☆27Updated 11 months ago
• yolky / RFAD
  Code for the paper "Efficient Dataset Distillation using Random Feature Approximation"
  ☆36Updated last year
• zju-vipa / NetGraft
  The implementation of AAAI 2021 Paper: "Progressive Network Grafting for Few-Shot Knowledge Distillation".
  ☆31Updated last month
• samuelstanton / gnosis
  Code to reproduce experiments from 'Does Knowledge Distillation Really Work' a paper which appeared in the 2021 NeurIPS proceedings.
  ☆32Updated 11 months ago
• dydjw9 / Efficient_SAM
  ☆57Updated last year
• xuguodong03 / UNIXKD
  ☆26Updated last year
• MingSun-Tse / TPP
  [ICLR'23] Trainability Preserving Neural Pruning (PyTorch)
  ☆29Updated last year