johnkorn / distillationLinks
Keras + tensorflow experiments with knowledge distillation on EMNIST dataset
☆34Updated 8 years ago
Alternatives and similar repositories for distillation
Users that are interested in distillation are comparing it to the libraries listed below
Sorting:
- A machine learning experiment☆180Updated 7 years ago
- Knowledge Distillation using Tensorflow☆142Updated 6 years ago
- Focal Loss of multi-classification in tensorflow☆81Updated 6 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆78Updated 7 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 6 years ago
- Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN☆28Updated 8 years ago
- lookahead optimizer for keras☆171Updated 5 years ago
- YOLO-v2, ResNet-32, GoogLeNet-lite☆34Updated 6 years ago
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 5 years ago
- Knowledge distillation methods implemented with Tensorflow (now there are 11 (+1) methods, and will be added more.)☆265Updated 5 years ago
- This repo is created using the code of Adrian Rosebrock's tutorial on Multi-label classification.☆34Updated 6 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- ☆143Updated 7 years ago
- Tensorflow code for training different architectures(DenseNet, ResNet, AlexNet, GoogLeNet, VGG, NiN) on ImageNet dataset + Multi-GPU supp…☆170Updated 6 years ago
- An implementation for mnist center loss training and visualization☆75Updated 7 years ago
- Reproduce selected deep learning models from scratch in PyTorch☆61Updated 5 years ago
- The codes for recent knowledge distillation algorithms and benchmark results via TF2.0 low-level API☆112Updated 3 years ago
- Teaches a student network from the knowledge obtained via training of a larger teacher network☆158Updated 7 years ago
- Tensorflow version implementation of focal loss for binary and multi classification☆109Updated 6 years ago
- A curated list of AutoML papers/tutorials/slides etc.☆91Updated 6 years ago
- Ensembling ConvNets using Keras☆75Updated 6 years ago
- Corrupted labels and label smoothing☆129Updated 8 years ago
- A Gluon implement of Residual Attention Network. Best acc on cifar10-97.78%.☆107Updated 6 years ago
- Implementation of model compression with knowledge distilling method.☆342Updated 8 years ago
- Keras implementation of knowledge distillation(Hinton, et al. 2015)☆19Updated 6 years ago
- A universal and efficient framework for training well-performing light net☆125Updated 8 years ago
- 11th place solution for Kaggle Human Protein Atlas Image Classification☆81Updated 6 years ago
- Multi heads attention for image classification☆79Updated 7 years ago
- ☆18Updated 6 years ago
- Implementation of Learning Rate Finder, SGDR and Cyclical Learning Rate in Keras☆29Updated 7 years ago