tejasgodambe / knowledge-distillation
Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN
☆28Updated 7 years ago
Alternatives and similar repositories for knowledge-distillation:
Users that are interested in knowledge-distillation are comparing it to the libraries listed below
- ☆50Updated 5 years ago
- Implementation of Data-free Knowledge Distillation for Deep Neural Networks (on arxiv!)☆81Updated 7 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆48Updated 5 years ago
- Sparse Recurrent Neural Networks -- Pruning Connections and Hidden Sizes (TensorFlow)☆74Updated 4 years ago
- This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training …☆46Updated 6 years ago
- A machine learning experiment☆180Updated 7 years ago
- Xuhong Li, Yves Grandvalet, and Franck Davoine. "Explicit Inductive Bias for Transfer Learning with Convolutional Networks." In ICML 2018…☆55Updated 6 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆36Updated 7 years ago
- Tensorflow Implementation on Paper [ECCV2018]Semi-Supervised Deep Learning with Memory☆47Updated 6 years ago
- Keras + tensorflow experiments with knowledge distillation on EMNIST dataset☆34Updated 7 years ago
- SupportNet: solving catastrophic forgetting in class incremental learning with support data☆34Updated 6 years ago
- PyTorch implementation of "Distilling the Knowledge in a Neural Network" for model compression☆59Updated 7 years ago
- Knowledge Distillation using Tensorflow☆142Updated 5 years ago
- Code release for "Learning Multiple Tasks with Multilinear Relationship Networks" (NIPS 2017)☆70Updated 7 years ago
- pytorch implementation of Structured Bayesian Pruning☆19Updated 6 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- ☆22Updated 2 years ago
- [ICML 2018] "Deep k-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutions"☆152Updated 3 years ago
- Demonising Adversarial Auto-encoder in PyTorch☆24Updated 6 years ago
- Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)☆104Updated 5 years ago
- The source code for Temporal Attention-Gated Model.☆21Updated 7 years ago
- python image data augmentation☆12Updated 7 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 6 years ago
- Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks☆18Updated 5 years ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated last year
- ☆37Updated 2 years ago
- resnet_cifar10_cifar100_imagenet☆13Updated 6 years ago
- Code for DOPING: Generative Data Augmentation for Unsupervised Anomaly Detection with GAN☆15Updated 6 years ago
- NeurIPS'19: Meta-Weight-Net: Learning an Explicit Mapping For Sample Weighting (Pytorch implementation for class imbalance).☆33Updated 5 years ago
- Unofficial pytorch implementation of Born-Again Neural Networks.☆53Updated 3 years ago