Tejalsjsu / DeepGradientCompression

It is implementation of Research paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING". Deep gradient compression is a technique by which the gradients are compressed before they are being sent. This approach greatly reduces the communication bandwidth and thus improves multi node training.
18Updated 5 years ago

Alternatives and similar repositories for DeepGradientCompression:

Users that are interested in DeepGradientCompression are comparing it to the libraries listed below