johnkorn / distillationLinks
Keras + tensorflow experiments with knowledge distillation on EMNIST dataset
☆34Updated 7 years ago
Alternatives and similar repositories for distillation
Users that are interested in distillation are comparing it to the libraries listed below
Sorting:
- Knowledge Distillation using Tensorflow☆142Updated 5 years ago
- Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN☆28Updated 8 years ago
- A machine learning experiment☆180Updated 7 years ago
- Focal Loss of multi-classification in tensorflow☆81Updated 6 years ago
- Multi heads attention for image classification☆80Updated 7 years ago
- Simple Tensorflow implementation of Squeeze Excitation Networks (ResNeXt, Inception-v4, Inception-resnet-v2). Include focal loss, center …☆10Updated 7 years ago
- Keras implementation of temporal ensembling(semi-supervised learning)☆22Updated 6 years ago
- Text classification models: cnn, self-attention, cnn-rnf, rnn-att, capsule-net. TensorFlow. Single GPU or multi GPU☆19Updated 5 years ago
- The codes for recent knowledge distillation algorithms and benchmark results via TF2.0 low-level API☆110Updated 3 years ago
- It contains the Attention-56 and Attention-96 models built from scratch in keras. Residual Attention Networks are described in the paper …☆38Updated 6 years ago
- ☆61Updated 7 years ago
- YOLO-v2, ResNet-32, GoogLeNet-lite☆35Updated 6 years ago
- pytorch implement of Label Smoothing☆32Updated 5 years ago
- This repo is an implementation of quantized CNN for both weights (1-bit compression) and feature maps (2-bit compression).☆18Updated 6 years ago
- Keras implementation of Octave Convolutions☆53Updated 6 years ago
- Ensembling ConvNets using Keras☆75Updated 6 years ago
- Cyclic learning rate TensorFlow implementation.☆66Updated 6 years ago
- resnet_cifar10_cifar100_imagenet☆13Updated 6 years ago
- DropBlock implemented in Keras☆26Updated 3 years ago
- An implementation for mnist center loss training and visualization☆75Updated 7 years ago
- Tensorflow version implementation of focal loss for binary and multi classification☆110Updated 6 years ago
- RAdam optimizer for keras☆71Updated 5 years ago
- Keras implementation of knowledge distillation(Hinton, et al. 2015)☆19Updated 6 years ago
- Try to use tf.estimator and tf.data together to train a cnn model.☆79Updated 6 years ago
- Center loss implementation in Keras☆41Updated 7 years ago
- A Gluon implement of Residual Attention Network. Best acc on cifar10-97.78%.☆108Updated 5 years ago
- ☆18Updated 6 years ago
- Focal Loss implementation by Keras with TensorFlow backend☆42Updated 7 years ago
- Octave convolution☆34Updated 3 years ago
- A practical example on how to combine both a CNN and a RNN to classify images.☆53Updated 8 years ago