EricHe98 / Teacher-Student-Training
This repository stores the files used for my summer internship's work on "teacher-student learning", an experimental method for training deep neural networks using a trained teacher model.
☆46Updated 6 years ago
Alternatives and similar repositories for Teacher-Student-Training
Users that are interested in Teacher-Student-Training are comparing it to the libraries listed below
Sorting:
- Transfer knowledge from a large DNN or an ensemble of DNNs into a small DNN☆28Updated 8 years ago
- ☆100Updated 4 years ago
- Re-implementation of the Noise Contrastive Estimation algorithm for pyTorch, following "Noise-contrastive estimation: A new estimation pr…☆45Updated 5 years ago
- ☆32Updated 6 years ago
- Xuhong Li, Yves Grandvalet, and Franck Davoine. "Explicit Inductive Bias for Transfer Learning with Convolutional Networks." In ICML 2018…☆56Updated 6 years ago
- PyTorch implementation of "SNAPSHOT ENSEMBLES: TRAIN 1, GET M FOR FREE" [WIP]☆36Updated 7 years ago
- A PyTorch implementation of semantic segmentation according to Multi-Scale Context Aggregation by Dilated Convolutions by Yu and Koltun.☆36Updated 6 years ago
- Meta-SGD Algorithms Implementation☆22Updated 10 months ago
- Implementation from the paper Attention Augmented Convolutional Networks in Tensorflow (https://arxiv.org/pdf/1904.09925v1.pdf)☆46Updated 6 years ago
- Pytorch code for the IEEE TM/ECCV paper "Attend and rectify"☆53Updated 5 years ago
- Implementation of Octave Convolution from Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convol…☆57Updated 6 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆53Updated 6 years ago
- SupportNet: solving catastrophic forgetting in class incremental learning with support data☆34Updated 6 years ago
- Tensorflow Implementation on Paper [ECCV2018]Semi-Supervised Deep Learning with Memory☆47Updated 6 years ago
- A Pytorch implementation of "LegoNet: Efficient Convolutional Neural Networks with Lego Filters" (ICML 2019).☆140Updated 4 years ago
- A Pytorch implementation of https://arxiv.org/abs/1810.12348.☆37Updated 6 years ago
- Implementing MixNet: Mixed Depthwise Convolutional Kernels using Pytorch☆62Updated 4 years ago
- Unsupervised Data Augmentation experiments in PyTorch☆59Updated 5 years ago
- A PyTorch implementation for Unsupervised Data Augmentation☆23Updated 2 years ago
- Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".☆101Updated 5 years ago
- Chainer implementation of deep-INFOMAX☆34Updated 6 years ago
- Corrupted labels and label smoothing☆129Updated 7 years ago
- Notes and tutorials on "Mutual information and self-supervised learning"☆39Updated 5 years ago
- supervised and semi-supervised image classification with self-supervision (Keras)☆45Updated 4 years ago
- ☆50Updated 5 years ago
- Official repository for "Why are Saliency Maps Noisy? Cause of and Solution to Noisy Saliency Maps".☆34Updated 5 years ago
- Momentum Contrast for Unsupervised Visual Representation Learning☆15Updated 2 years ago
- Multi-Label Image Classification via Knowledge Distillation from Weakly-Supervised Detection (ACM MM 2018)☆58Updated 3 years ago
- Awesome papers in few-shot learning/one-shot learning.☆30Updated 6 years ago
- SSL using PyTorch☆49Updated 5 years ago