johnkorn / distillation
Keras + tensorflow experiments with knowledge distillation on EMNIST dataset
☆34Updated 7 years ago
Alternatives and similar repositories for distillation:
Users that are interested in distillation are comparing it to the libraries listed below
- Knowledge Distillation using Tensorflow☆142Updated 5 years ago
- Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN☆28Updated 7 years ago
- A machine learning experiment☆180Updated 7 years ago
- Text classification models: cnn, self-attention, cnn-rnf, rnn-att, capsule-net. TensorFlow. Single GPU or multi GPU☆19Updated 5 years ago
- Octave convolution☆34Updated 3 years ago
- resnet_cifar10_cifar100_imagenet☆13Updated 6 years ago
- Keras implementation of Octave Convolutions☆53Updated 6 years ago
- Focal Loss of multi-classification in tensorflow☆80Updated 6 years ago
- wrapping a keras optimizer to implement gradient accumulation☆119Updated 4 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- YOLO-v2, ResNet-32, GoogLeNet-lite☆35Updated 5 years ago
- Focal Loss implementation by Keras with TensorFlow backend☆42Updated 7 years ago
- It contains the Attention-56 and Attention-96 models built from scratch in keras. Residual Attention Networks are described in the paper …☆38Updated 6 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 6 years ago
- Simple Tensorflow implementation of Squeeze Excitation Networks (ResNeXt, Inception-v4, Inception-resnet-v2). Include focal loss, center …☆10Updated 7 years ago
- Keras Label Smoothing for Supervised Learning☆11Updated 4 years ago
- Bilinear CNN implementation using keras☆35Updated 6 years ago
- An implementation for mnist center loss training and visualization☆75Updated 7 years ago
- pytorch implement of Label Smoothing☆32Updated 5 years ago
- Keras implementation of temporal ensembling(semi-supervised learning)☆22Updated 6 years ago
- Implementation in Keras of: Snapshot Ensembles: Train 1, get M for free (https://arxiv.org/abs/1704.00109)☆26Updated 6 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆79Updated 6 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆36Updated 7 years ago
- Tensorflow version implementation of focal loss for binary and multi classification☆110Updated 6 years ago
- Multi-class classification with focal loss for imbalanced datasets☆82Updated 5 years ago
- Dual Path Networks for Keras 2.0+☆113Updated 5 years ago
- Kaggle Doodle Recognition Challenge 2018 code☆14Updated 6 years ago
- zero short learning☆31Updated 6 years ago
- Model Compression Based on Geoffery Hinton's Logit Regression Method in Keras applied to MNIST 16x compression over 0.95 percent accuracy…☆61Updated 5 years ago
- Implement Pruning Convolutional Neural Networks for Resource Efficient Inference with Keras framework☆16Updated 7 years ago