tejasgodambe / knowledge-distillationLinks
Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN
☆28Updated 8 years ago
Alternatives and similar repositories for knowledge-distillation
Users that are interested in knowledge-distillation are comparing it to the libraries listed below
Sorting:
- This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training …☆47Updated 6 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆36Updated 8 years ago
- A machine learning experiment☆180Updated 8 years ago
- Unofficial pytorch implementation of Born-Again Neural Networks.☆56Updated 4 years ago
- ☆51Updated 6 years ago
- 6️⃣6️⃣6️⃣ Reproduce ICLR '18 under-reviewed paper "MULTI-TASK LEARNING ON MNIST IMAGE DATASETS"☆42Updated 7 years ago
- PyTorch implementation of "Distilling the Knowledge in a Neural Network" for model compression☆59Updated 8 years ago
- Code for https://arxiv.org/abs/1810.04622☆140Updated 6 years ago
- Curriculum Learning - Tensorflow☆40Updated 7 years ago
- Model Compression Based on Geoffery Hinton's Logit Regression Method in Keras applied to MNIST 16x compression over 0.95 percent accuracy…☆61Updated 6 years ago
- Knowledge Distillation using Tensorflow☆142Updated 6 years ago
- Xuhong Li, Yves Grandvalet, and Franck Davoine. "Explicit Inductive Bias for Transfer Learning with Convolutional Networks." In ICML 2018…☆56Updated 7 years ago
- Teaches a student network from the knowledge obtained via training of a larger teacher network☆159Updated 7 years ago
- Code release for "Learning Multiple Tasks with Multilinear Relationship Networks" (NIPS 2017)☆71Updated 7 years ago
- resnet_cifar10_cifar100_imagenet☆14Updated 7 years ago
- Implementation of Octave Convolution from Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convol…☆57Updated 6 years ago
- Towards Automated Deep Learning: Efficient Joint Neural Architecture and Hyperparameter Search https://arxiv.org/abs/1807.06906☆49Updated 5 years ago
- Knowledge Transfer via Distillation of Activation Boundaries Formed by Hidden Neurons (AAAI 2019)☆105Updated 6 years ago
- pytorch implementation of Structured Bayesian Pruning☆19Updated 7 years ago
- Cost-Effective Object Detection: Active Sample Mining with Switchable Selection Criteria☆12Updated 7 years ago
- ☆46Updated 5 years ago
- Sparse Recurrent Neural Networks -- Pruning Connections and Hidden Sizes (TensorFlow)☆74Updated 5 years ago
- Implementation from the paper Attention Augmented Convolutional Networks in Tensorflow (https://arxiv.org/pdf/1904.09925v1.pdf)☆45Updated 6 years ago
- ☆22Updated 3 years ago
- Code for DOPING: Generative Data Augmentation for Unsupervised Anomaly Detection with GAN☆15Updated 7 years ago
- ☆100Updated 5 years ago
- Stochastic Adaptive Neural Architecture Search☆65Updated 7 years ago
- ☆37Updated 3 years ago
- [ICML 2018] "Deep k-Means: Re-Training and Parameter Sharing with Harder Cluster Assignments for Compressing Deep Convolutions"☆152Updated 3 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆54Updated 7 years ago