Implementation of (overlap) local SGD in Pytorch
☆34Jul 12, 2020Updated 6 years ago
Alternatives and similar repositories for Overlap_Local_SGD
Users that are interested in Overlap_Local_SGD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆46Mar 4, 2020Updated 6 years ago
- Communication-efficient decentralized SGD (Pytorch)☆23Mar 17, 2020Updated 6 years ago
- Stochastic Gradient Push for Distributed Deep Learning☆172Apr 5, 2023Updated 3 years ago
- QSGD-TF☆21May 15, 2019Updated 7 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆74Sep 10, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- vector quantization for stochastic gradient descent.☆38May 12, 2020Updated 6 years ago
- Code for paper: Variance Reduced Local SGD with Lower Communication Complexity☆12May 20, 2020Updated 6 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- Parallel SGD, done locally and remote☆14May 19, 2016Updated 10 years ago
- FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion (NeurIPS 2024 Spotlight)☆15Mar 31, 2025Updated last year
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Jan 22, 2021Updated 5 years ago
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Nov 14, 2021Updated 4 years ago
- ☆14May 25, 2022Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Associated codebase for Byzantine-resilient distributed / decentralized machine learning papers from INSPIRE Lab☆14Oct 11, 2021Updated 4 years ago
- The implementation of FedBCD algorithm published in the paper "FedBCD: A Communication-Efficient Collaborative Learning Framework for Dis…☆16Jul 2, 2024Updated 2 years ago
- Code for the signSGD paper☆95Jan 12, 2021Updated 5 years ago
- Partial implementation of paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING"☆33Nov 20, 2020Updated 5 years ago
- CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883☆20Nov 30, 2021Updated 4 years ago
- SCAFFOLD and FedAvg implementation☆61Jul 20, 2021Updated 5 years ago
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- ☆34Feb 10, 2023Updated 3 years ago
- The project is related to the development of labs for the ITMO Speaker Recognition Course.☆16Jul 3, 2026Updated 2 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆11Jan 2, 2022Updated 4 years ago
- ☆10Mar 31, 2025Updated last year
- "What is Learned in Visually Grounded Neural Syntax Acquisition", Noriyuki Kojima, Hadar Averbuch-Elor, Alexander Rush and Yoav Artzi (AC…☆12Dec 30, 2021Updated 4 years ago
- Code Release for "On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies"☆16Apr 13, 2021Updated 5 years ago
- Personalized Federated Learning with Moreau Envelopes (pFedMe) using Pytorch (NeurIPS 2020)☆310Apr 18, 2022Updated 4 years ago
- ☆22Apr 6, 2021Updated 5 years ago
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- Companion code to the preprint: E Bıyık, K Wang, N Anari, D Sadigh, "Batch Active Learning using Determinantal Point Processes". arXiv pr…☆14Jul 25, 2024Updated 2 years ago
- This code was finished before source code hasn't been released.☆27Nov 18, 2019Updated 6 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆38Jan 15, 2021Updated 5 years ago
- FL_PyTorch: Optimization Research Simulator for Federated Learning☆36Jul 7, 2023Updated 3 years ago
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Oct 25, 2019Updated 6 years ago
- CMFL: Mitigating Communication Overhead for Federated Learning / PyTorch reimplementation.☆28Oct 18, 2019Updated 6 years ago
- How to use AWS IoT Greengrass V2 for Image classification and Video Analytics Pipelines☆20May 21, 2021Updated 5 years ago
- Implementation of Parameter Server using PyTorch communication lib☆41Apr 7, 2019Updated 7 years ago