tejasgodambe / knowledge-distillation
Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN
☆28Updated 7 years ago
Alternatives and similar repositories for knowledge-distillation:
Users that are interested in knowledge-distillation are comparing it to the libraries listed below
- This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training …☆46Updated 6 years ago
- Zero-Shot Knowledge Distillation in Deep Networks in ICML2019☆48Updated 5 years ago
- ☆49Updated 5 years ago
- Keras + tensorflow experiments with knowledge distillation on EMNIST dataset☆34Updated 7 years ago
- PyTorch implementation of "Distilling the Knowledge in a Neural Network" for model compression☆59Updated 7 years ago
- Teaches a student network from the knowledge obtained via training of a larger teacher network☆156Updated 6 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆36Updated 7 years ago
- 6️⃣6️⃣6️⃣ Reproduce ICLR '18 under-reviewed paper "MULTI-TASK LEARNING ON MNIST IMAGE DATASETS"☆41Updated 6 years ago
- Knowledge Distillation using Tensorflow☆141Updated 5 years ago
- resnet_cifar10_cifar100_imagenet☆13Updated 6 years ago
- The source code for Temporal Attention-Gated Model.☆21Updated 7 years ago
- Implementation of Data-free Knowledge Distillation for Deep Neural Networks (on arxiv!)☆78Updated 6 years ago
- A machine learning experiment☆181Updated 7 years ago
- Sparse Recurrent Neural Networks -- Pruning Connections and Hidden Sizes (TensorFlow)☆74Updated 4 years ago
- A demonstration of how to use PyTorch to implement Support Vector Machine with L2 regularizition and multiclass hinge loss☆47Updated 6 years ago
- Deep Neural Network Compression based on Student-Teacher Network☆14Updated last year
- Reversible Recurrent Neural Network Pytorch Implementation☆21Updated 7 years ago
- SupportNet: solving catastrophic forgetting in class incremental learning with support data☆34Updated 6 years ago
- Code for DOPING: Generative Data Augmentation for Unsupervised Anomaly Detection with GAN☆15Updated 6 years ago
- Xuhong Li, Yves Grandvalet, and Franck Davoine. "Explicit Inductive Bias for Transfer Learning with Convolutional Networks." In ICML 2018…☆55Updated 6 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆52Updated 6 years ago
- ☆25Updated 5 years ago
- ☆22Updated 2 years ago
- Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks☆18Updated 5 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 6 years ago
- code for triplet GAN☆31Updated 6 years ago
- Unofficial pytorch implementation of Born-Again Neural Networks.☆53Updated 3 years ago
- Meta-SGD Algorithms Implementation☆22Updated 6 months ago
- Reducing the size of convolutional neural networks☆114Updated 7 years ago
- Model Compression Based on Geoffery Hinton's Logit Regression Method in Keras applied to MNIST 16x compression over 0.95 percent accuracy…☆61Updated 5 years ago