hosseinshn / GradNorm
This in my Demo of Chen et al. "GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks" ICML 2018
☆174Updated 3 years ago
Alternatives and similar repositories for GradNorm:
Users that are interested in GradNorm are comparing it to the libraries listed below
- Pytorch implementation of the GradNorm. GradNorm addresses the problem of balancing multiple losses for multi-task learning by learning a…☆261Updated 2 years ago
- ☆145Updated 3 years ago
- Unofficial implementation of: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics☆551Updated 3 years ago
- Multi-Task Learning Framework on PyTorch. State-of-the-art methods are implemented to effectively train models on multiple tasks.☆149Updated 5 years ago
- MSc group project: Reproduction of 'Multi-Task Learning using Uncertainty to Weigh Losses for Scene Geometry and Semantics'; A. Kendall, …☆88Updated 5 years ago
- Official Implementation of ICML 2019 Unsupervised label noise modeling and loss correction☆222Updated 4 years ago
- Code for "Gradient Surgery for Multi-Task Learning"☆317Updated 4 years ago
- The implementation of "Self-Supervised Generalisation with Meta Auxiliary Learning" [NeurIPS 2019].☆173Updated 3 years ago
- A Tensorflow implementation of the paper arXiv:1604.03539☆128Updated 6 years ago
- Virtual Adversarial Training (VAT) implementation for PyTorch☆296Updated 6 years ago
- lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch☆334Updated 5 years ago
- Multi Task Learning Implementation with Homoscedastic Uncertainty in Tensorflow☆53Updated 6 years ago
- Implements https://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neu…☆149Updated 5 years ago
- [ICML 2020] Efficient Continuous Pareto Exploration in Multi-Task Learning☆142Updated 3 years ago
- [ICML 2020] code for the flooding regularizer proposed in "Do We Need Zero Training Loss After Achieving Zero Training Error?"☆91Updated 2 years ago
- Pytorch implementation of Virtual Adversarial Training☆134Updated 5 years ago
- Learning deep representations by mutual information estimation and maximization☆324Updated 6 years ago
- Learning What and Where to Transfer (ICML 2019)☆248Updated 4 years ago
- Tensorflow implementation of "Learning to Balance: Bayesian Meta-learning for Imbalanced and Out-of-distribution Tasks" (ICLR 2020 oral)☆100Updated 4 years ago
- Full implementation of the paper "Rethinking Softmax with Cross-Entropy: Neural Network Classifier as Mutual Information Estimator".☆101Updated 5 years ago
- Code for NeurIPS 2019 Paper, "L_DMI: An Information-theoretic Noise-robust Loss Function"☆119Updated last year
- Unofficial PyTorch Implementation of Unsupervised Data Augmentation.☆146Updated 4 years ago
- Codes for "Learning Sparse Sharing Architectures for Multiple Tasks"☆93Updated 4 years ago
- AdaShare: Learning What To Share For Efficient Deep Multi-Task Learning☆112Updated 4 years ago
- PyTorch Implementation of the paper Learning to Reweight Examples for Robust Deep Learning☆354Updated 5 years ago
- Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"☆327Updated 3 years ago
- The Implementation of "Auto-Lambda: Disentangling Dynamic Task Relationships" [TMLR 2022].☆133Updated 2 years ago
- Reproduction of Momentum Contrast for Unsupervised Visual Representation Learning☆120Updated 8 months ago
- Official PyTorch Repo for "ReZero is All You Need: Fast Convergence at Large Depth"☆407Updated 8 months ago
- pytorch implement of Lookahead Optimizer☆189Updated 2 years ago