Alternatives and similar repositories for cola:

Users that are interested in cola are comparing it to the libraries listed below

• jiaweizzhao / signSGD-with-Majority-Vote
  ☆74Updated 5 years ago
• epfml / ChocoSGD
  Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356
  ☆66Updated 4 years ago
• jxbz / signSGD
  Code for the signSGD paper
  ☆83Updated 4 years ago
• dhroth / sketchedsgd
  Sketched SGD
  ☆28Updated 4 years ago
• eugenium / DGL
  ☆30Updated 4 years ago
• wenwei202 / smoothout
  SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learning
  ☆23Updated 6 years ago
• rdspring1 / Count-Sketch-Optimizers
  A compressed adaptive optimizer for training large-scale deep learning models using PyTorch
  ☆27Updated 5 years ago
• litian96 / TERM
  Tilted Empirical Risk Minimization (ICLR '21)
  ☆59Updated last year
• alshedivat / fedpa
  Federated posterior averaging implemented in JAX
  ☆51Updated last year
• hwang595 / ps_pytorch
  implement distributed machine learning with Pytorch + OpenMPI
  ☆51Updated 5 years ago
• johncava / SVRG-pytorch
  Implementation of Stochastic Variance Reduced Gradient Descent
  ☆8Updated 7 years ago
• nikitaivkin / csh
  Simple Hierarchical Count Sketch in Python
  ☆20Updated 3 years ago
• hwang595 / ATOMO
  Atomo: Communication-efficient Learning via Atomic Sparsification
  ☆25Updated 6 years ago
• srQ-cpc / D-PSGD
  Algorithm: Decentralized Parallel Stochastic Gradient Descent
  ☆41Updated 6 years ago
• epfml / error-feedback-SGD
  SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847
  ☆31Updated 7 months ago
• epfml / sparsifiedSGD
  Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599
  ☆59Updated 6 years ago
• dayu11 / Gradient-Embedding-Perturbation
  ☆27Updated 2 years ago
• ruosongwang / CNTK
  Convolutional Neural Tangent Kernel
  ☆109Updated 5 years ago
• facebookresearch / stochastic_gradient_push
  Stochastic Gradient Push for Distributed Deep Learning
  ☆160Updated last year
• epfml / LocalSGD-Code
  ☆46Updated 5 years ago
• kilianFatras / variance_reduced_neural_networks
  Implementation of SVRG and SAGA optimization algorithms for deep learning topics.
  ☆70Updated 4 years ago
• AnonymousNIPS2019 / DeepnetHessian
  The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size
  ☆17Updated 5 years ago
• thegregyang / NTK4A
  Code for the paper: "Tensor Programs II: Neural Tangent Kernel for Any Architecture"
  ☆105Updated 4 years ago
• fKunstner / fast-individual-gradients-with-autodiff
  ☆26Updated 5 years ago
• facebookresearch / foltr-es
  The source code to reproduce the results reported in the 'Federated Online Learning to Rank with Evolution Strategies' paper, published a…
  ☆33Updated 3 years ago
• epfml / topology-in-decentralized-learning
  Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.
  ☆13Updated 2 years ago
• JYWa / Overlap_Local_SGD
  Implementation of (overlap) local SGD in Pytorch
  ☆33Updated 4 years ago
• IBM / ZOSVRG-BlackBox-Adv
  ZOSVRG-BlackBox-Adv
  ☆11Updated 6 years ago
• tonyduan / rs4a
  Randomized Smoothing of All Shapes and Sizes (ICML 2020).
  ☆52Updated 4 years ago
• mmahesh / variants-of-rmsprop-and-adagrad
  SC-Adagrad, SC-RMSProp and RMSProp algorithms for training deep networks proposed in
  ☆14Updated 6 years ago