hosseinshn / GradNorm
This in my Demo of Chen et al. "GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks" ICML 2018
☆172Updated 3 years ago
Alternatives and similar repositories for GradNorm:
Users that are interested in GradNorm are comparing it to the libraries listed below
- Pytorch implementation of the GradNorm. GradNorm addresses the problem of balancing multiple losses for multi-task learning by learning a…☆259Updated 2 years ago
- ☆144Updated 3 years ago
- MSc group project: Reproduction of 'Multi-Task Learning using Uncertainty to Weigh Losses for Scene Geometry and Semantics'; A. Kendall, …☆87Updated 5 years ago
- Multi-Task Learning Framework on PyTorch. State-of-the-art methods are implemented to effectively train models on multiple tasks.☆149Updated 5 years ago
- Unofficial implementation of: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics☆550Updated 3 years ago
- The implementation of "Self-Supervised Generalisation with Meta Auxiliary Learning" [NeurIPS 2019].☆173Updated 3 years ago
- A Tensorflow implementation of the paper arXiv:1604.03539☆127Updated 6 years ago
- Code for "Gradient Surgery for Multi-Task Learning"☆313Updated 4 years ago
- AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning☆112Updated 4 years ago
- [ICML 2020] Efficient Continuous Pareto Exploration in Multi-Task Learning☆142Updated 3 years ago
- PyTorch implementation of the GradNorm☆83Updated 5 months ago
- Virtual Adversarial Training (VAT) implementation for PyTorch☆296Updated 6 years ago
- Codes for "Learning Sparse Sharing Architectures for Multiple Tasks"☆92Updated 4 years ago
- Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neu…☆149Updated 5 years ago
- Official implementation of Auxiliary Learning by Implicit Differentiation [ICLR 2021]☆84Updated 7 months ago
- Reproduction of Momentum Contrast for Unsupervised Visual Representation Learning☆120Updated 7 months ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago
- Code for NeurIPS 2019 Paper, "L_DMI: An Information-theoretic Noise-robust Loss Function"☆118Updated last year
- The implementation of "End-to-End Multi-Task Learning with Attention" [CVPR 2019].☆685Updated 3 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆53Updated 6 years ago
- Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"☆321Updated 3 years ago
- Tensorflow implementation of "Learning to Balance: Bayesian Meta-learning for Imbalanced and Out-of-distribution Tasks" (ICLR 2020 oral)☆99Updated 4 years ago
- PyTorch Implementations of Dropout Variants☆87Updated 7 years ago
- A multi-task learning example for the paper https://arxiv.org/abs/1705.07115☆854Updated 4 years ago
- Official Implementation of ICML 2019 Unsupervised label noise modeling and loss correction☆222Updated 4 years ago
- Pytorch implementation of Virtual Adversarial Training☆133Updated 5 years ago
- A list of multi-task learning papers and projects.☆369Updated 3 years ago
- PyTorch Implementation of the paper Learning to Reweight Examples for Robust Deep Learning☆354Updated 5 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆334Updated 5 years ago
- This is a repository for Multi-task learning with toy data in Pytorch and Tensorflow☆136Updated 6 years ago