This in my Demo of Chen et al. "GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks" ICML 2018
☆182Nov 2, 2021Updated 4 years ago
Alternatives and similar repositories for GradNorm
Users that are interested in GradNorm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of the GradNorm. GradNorm addresses the problem of balancing multiple losses for multi-task learning by learning a…☆272Aug 9, 2022Updated 4 years ago
- a much more complex case using GradNorm, where the layer sharing situation is sophisticated.☆16Feb 21, 2019Updated 7 years ago
- Loss-Balanced Task Weighting to Reduce Negative Transfer in Multi-Task Learning, AAAI-SA'19☆30Sep 23, 2019Updated 6 years ago
- Multi-Task Learning Framework on PyTorch. State-of-the-art methods are implemented to effectively train models on multiple tasks.☆150Jun 3, 2019Updated 7 years ago
- A multi-task learning example for the paper https://arxiv.org/abs/1705.07115☆871Jul 6, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Unofficial implementation of: Multi-task learning using uncertainty to weigh losses for scene geometry and semantics☆566Nov 1, 2021Updated 4 years ago
- A list of multi-task machine learning papers.☆36Nov 4, 2018Updated 7 years ago
- ☆148Dec 13, 2021Updated 4 years ago
- [ICML 2020] Efficient Continuous Pareto Exploration in Multi-Task Learning☆149Aug 12, 2021Updated 5 years ago
- The implementation of "End-to-End Multi-Task Learning with Attention" [CVPR 2019].☆735Feb 7, 2022Updated 4 years ago
- ☆11Nov 14, 2020Updated 5 years ago
- Source code for Neural Information Processing Systems (NeurIPS) 2018 paper "Multi-Task Learning as Multi-Objective Optimization"☆1,068Sep 2, 2024Updated 2 years ago
- ☆19Mar 5, 2019Updated 7 years ago
- Awesome Multitask Learning Resources☆673Apr 13, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- MSc group project: Reproduction of 'Multi-Task Learning using Uncertainty to Weigh Losses for Scene Geometry and Semantics'; A. Kendall, …☆93Nov 8, 2019Updated 6 years ago
- Official implementation of Auxiliary Learning by Implicit Differentiation [ICLR 2021]☆86Jul 25, 2024Updated 2 years ago
- Code for "Gradient Surgery for Multi-Task Learning"☆368Apr 28, 2020Updated 6 years ago
- Attentive Single-tasking of Multiple Tasks☆85Oct 27, 2019Updated 6 years ago
- Code for Neural Information Processing Systems (NeurIPS) 2019 paper: Pareto Multi-Task Learning☆144Jan 2, 2020Updated 6 years ago
- Pytorch reimplementation for "Gradient Surgery for Multi-Task Learning"☆404Jun 22, 2021Updated 5 years ago
- This is a repository for Multi-task learning with toy data in Pytorch and Tensorflow☆137Sep 23, 2018Updated 7 years ago
- A list of multi-task learning papers and projects.☆387Jan 31, 2022Updated 4 years ago
- The Implementation of "Auto-Lambda: Disentangling Dynamic Task Relationships" [TMLR 2022].☆141Feb 5, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Official PyTorch Implementation for Conflict-Averse Gradient Descent (CAGrad)☆158Nov 9, 2023Updated 2 years ago
- ☆78Nov 15, 2022Updated 3 years ago
- Implementation for our WACV 2021 paper "Multi-Loss Weighting with Coefficient of Variations"☆55Jan 11, 2021Updated 5 years ago
- Jarvis is a toolbox built on top of TensorFlow2.0 that allows developers and researchers to easily build neural networks in TensorFlow, p…☆37Oct 15, 2020Updated 5 years ago
- Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Mo…☆16Nov 11, 2024Updated last year
- AdaTask: A Task-Aware Adaptive Learning Rate Approach to Multi-Task Learning. AAAI, 2023.☆30Sep 29, 2023Updated 2 years ago
- MTAdam: Automatic Balancing of Multiple Training Loss Terms☆37Nov 21, 2020Updated 5 years ago
- PyTorch implementation of JEM++: Improved Techniques for Training JEM☆13Mar 11, 2023Updated 3 years ago
- Collection of the latest, greatest, deep learning optimizers (for Pytorch) - CNN, NLP suitable☆218Apr 4, 2021Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- An uncertainty-based random sampling algorithm for data augmentation☆29Sep 7, 2020Updated 6 years ago
- Official Pytorch's implementation of RotoGrad☆85Aug 1, 2023Updated 3 years ago
- Multi-Task Learning Using Dynamic Weights of Tasks for Face Recognition withFacial Expression☆45May 8, 2020Updated 6 years ago
- ☆62Jul 11, 2019Updated 7 years ago
- [NeurIPS 2020 Oral] Is normalization indispensable for training deep neural networks?☆34Jun 22, 2022Updated 4 years ago
- An implementation of RaFM. Xiaoshuang Chen, Yin Zheng, Jiaxiang Wang, et al. "RaFM: Rank-Aware Factorization Machines"☆12May 11, 2019Updated 7 years ago
- ☆119Oct 16, 2021Updated 4 years ago