johnkorn / distillation
Keras + tensorflow experiments with knowledge distillation on EMNIST dataset
☆35Updated 7 years ago
Related projects: ⓘ
- resnet_cifar10_cifar100_imagenet☆13Updated 5 years ago
- Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN☆29Updated 7 years ago
- A machine learning experiment☆182Updated 6 years ago
- Focal Loss of multi-classification in tensorflow☆78Updated 5 years ago
- Knowledge Distillation using Tensorflow☆141Updated 5 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 5 years ago
- Multi heads attention for image classification☆80Updated 6 years ago
- Text classification models: cnn, self-attention, cnn-rnf, rnn-att, capsule-net. TensorFlow. Single GPU or multi GPU☆18Updated 4 years ago
- RAdam optimizer for keras☆71Updated 4 years ago
- Keras implementation of knowledge distillation(Hinton, et al. 2015)☆19Updated 5 years ago
- Keras implementation of temporal ensembling(semi-supervised learning)☆22Updated 5 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆25Updated 5 years ago
- Simple Tensorflow implementation of Squeeze Excitation Networks (ResNeXt, Inception-v4, Inception-resnet-v2). Include focal loss, center …☆10Updated 6 years ago
- YOLO-v2, ResNet-32, GoogLeNet-lite☆36Updated 5 years ago
- Keras implementation of Octave Convolutions☆53Updated 5 years ago
- Implementation of Learning Rate Finder, SGDR and Cyclical Learning Rate in Keras☆29Updated 6 years ago
- Unsupervised Data Augmentation experiments in PyTorch☆59Updated 5 years ago
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 4 years ago
- Octave convolution☆34Updated 2 years ago
- Bilinear CNN implementation using keras☆35Updated 6 years ago
- Focal Loss implementation by Keras with TensorFlow backend☆42Updated 6 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆79Updated 6 years ago
- 6️⃣6️⃣6️⃣ Reproduce ICLR '18 under-reviewed paper "MULTI-TASK LEARNING ON MNIST IMAGE DATASETS"☆42Updated 6 years ago
- A practical example on how to combine both a CNN and a RNN to classify images.☆51Updated 7 years ago
- ☆26Updated 4 years ago
- ☆18Updated 5 years ago
- Corrupted labels and label smoothing☆128Updated 6 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆52Updated 6 years ago
- An implementation for mnist center loss training and visualization☆75Updated 6 years ago
- Teaches a student network from the knowledge obtained via training of a larger teacher network☆154Updated 6 years ago