tejasgodambe / knowledge-distillation
Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN
☆28Updated 7 years ago
Alternatives and similar repositories for knowledge-distillation:
Users that are interested in knowledge-distillation are comparing it to the libraries listed below
- ☆49Updated 5 years ago
- This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training …☆46Updated 6 years ago
- Keras + tensorflow experiments with knowledge distillation on EMNIST dataset☆34Updated 7 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆48Updated 5 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆36Updated 7 years ago
- Xuhong Li, Yves Grandvalet, and Franck Davoine. "Explicit Inductive Bias for Transfer Learning with Convolutional Networks." In ICML 2018…☆55Updated 6 years ago
- A machine learning experiment☆181Updated 7 years ago
- Knowledge Distillation using Tensorflow☆142Updated 5 years ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated last year
- PyTorch implementation of "Distilling the Knowledge in a Neural Network" for model compression☆59Updated 7 years ago
- Demonising Adversarial Auto-encoder in PyTorch☆24Updated 6 years ago
- Implementation of Data-free Knowledge Distillation for Deep Neural Networks (on arxiv!)☆78Updated 7 years ago
- ☆37Updated 2 years ago
- pytorch implementation of Structured Bayesian Pruning☆19Updated 6 years ago
- 6️⃣6️⃣6️⃣ Reproduce ICLR '18 under-reviewed paper "MULTI-TASK LEARNING ON MNIST IMAGE DATASETS"☆41Updated 6 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- Keras implementation of knowledge distillation(Hinton, et al. 2015)☆19Updated 6 years ago
- Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)☆105Updated 5 years ago
- Sparse Recurrent Neural Networks -- Pruning Connections and Hidden Sizes (TensorFlow)☆74Updated 4 years ago
- Teaches a student network from the knowledge obtained via training of a larger teacher network☆156Updated 6 years ago
- Model Compression Based on Geoffery Hinton's Logit Regression Method in Keras applied to MNIST 16x compression over 0.95 percent accuracy…☆61Updated 5 years ago
- Code release for "Learning Multiple Tasks with Multilinear Relationship Networks" (NIPS 2017)☆70Updated 7 years ago
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- Tensorflow Implementation on Paper [ECCV2018]Semi-Supervised Deep Learning with Memory☆47Updated 5 years ago
- Initial Code for the paper "incremental learning through deep adaptation"☆50Updated 5 years ago
- The source code for Temporal Attention-Gated Model.☆21Updated 7 years ago
- Cost-Effective Object Detection: Active Sample Mining with Switchable Selection Criteria☆13Updated 6 years ago
- Code for the paper Adversarial Robustness via Adversarial Label-Smoothing☆12Updated 5 years ago
- code for triplet GAN☆31Updated 6 years ago
- Meta-SGD Algorithms Implementation☆22Updated 6 months ago