hosseinshn / GradNormLinks
This in my Demo of Chen et al. "GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks" ICML 2018
☆180Updated 3 years ago
Alternatives and similar repositories for GradNorm
Users that are interested in GradNorm are comparing it to the libraries listed below
Sorting:
- ☆148Updated 3 years ago
- Pytorch implementation of the GradNorm. GradNorm addresses the problem of balancing multiple losses for multi-task learning by learning a…☆270Updated 3 years ago
- A Tensorflow implementation of the paper arXiv:1604.03539☆133Updated 7 years ago
- Multi-Task Learning Framework on PyTorch. State-of-the-art methods are implemented to effectively train models on multiple tasks.☆149Updated 6 years ago
- MSc group project: Reproduction of 'Multi-Task Learning using Uncertainty to Weigh Losses for Scene Geometry and Semantics'; A. Kendall, …☆90Updated 5 years ago
- [ICML 2020] Efficient Continuous Pareto Exploration in Multi-Task Learning☆146Updated 4 years ago
- The implementation of "Self-Supervised Generalisation with Meta Auxiliary Learning" [NeurIPS 2019].☆177Updated 3 years ago
- Unofficial implementation of: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics☆556Updated 3 years ago
- Official implementation of Auxiliary Learning by Implicit Differentiation [ICLR 2021]☆85Updated last year
- Learning deep representations by mutual information estimation and maximization☆325Updated 6 years ago
- A collection of awesome things about mixed sample data augmentation☆132Updated 5 years ago
- Code for "Gradient Surgery for Multi-Task Learning"☆331Updated 5 years ago
- Official Implementation of ICML 2019 Unsupervised label noise modeling and loss correction☆224Updated 5 years ago
- AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning☆112Updated 4 years ago
- Official implementation of "Pseudo-Labeling and Confirmation Bias in Deep Semi-Supervised Learning"☆155Updated 4 years ago
- Multi-head attention in PyTorch☆153Updated 6 years ago
- Bootstrapping loss function implementation in pytorch☆36Updated 4 years ago
- Virtual Adversarial Training (VAT) implementation for PyTorch☆295Updated 6 years ago
- PyTorch Implementation of the paper Learning to Reweight Examples for Robust Deep Learning☆354Updated 6 years ago
- ICML 2019: Understanding and Utilizing Deep Neural Networks Trained with Noisy Labels☆91Updated 4 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆54Updated 6 years ago
- Reproduction of Momentum Contrast for Unsupervised Visual Representation Learning☆120Updated last year
- Tensorflow implementation of "Learning to Balance: Bayesian Meta-learning for Imbalanced and Out-of-distribution Tasks" (ICLR 2020 oral)☆101Updated 4 years ago
- Code for NeurIPS 2019 Paper, "L_DMI: An Information-theoretic Noise-robust Loss Function"☆119Updated 2 years ago
- CVPR'20: Combating Noisy Labels by Agreement: A Joint Training Method with Co-Regularization☆127Updated last year
- NeurIPS'18: Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels☆510Updated 4 years ago
- Code for ICCV2019 "Symmetric Cross Entropy for Robust Learning with Noisy Labels"☆172Updated 4 years ago
- [ICML 2021 Oral] We show pure attention suffers rank collapse, and how different mechanisms combat it.☆166Updated 4 years ago
- Learning What and Where to Transfer (ICML 2019)☆248Updated 4 years ago
- Pytorch implementation of Virtual Adversarial Training☆134Updated 6 years ago