vineeths96 / Gradient-Compression

We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We empirically evaluate the performance of the compression methods by training deep neural networks on the CIFAR10 dataset.
9Updated 3 years ago

Alternatives and similar repositories for Gradient-Compression:

Users that are interested in Gradient-Compression are comparing it to the libraries listed below