Implementation of (overlap) local SGD in Pytorch
☆34Jul 12, 2020Updated 6 years ago
Alternatives and similar repositories for Overlap_Local_SGD
Users that are interested in Overlap_Local_SGD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Stochastic Gradient Push for Distributed Deep Learning☆172Apr 5, 2023Updated 3 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆74Sep 10, 2020Updated 6 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- Dual-way gradient sparsification approach for async DNN training, based on PyTorch.☆10Dec 8, 2022Updated 3 years ago
- Repository that contains the code for the paper titled, 'Unifying Distillation with Personalization in Federated Learning'.☆14May 31, 2021Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆32Dec 3, 2019Updated 6 years ago
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- ☆26Apr 3, 2020Updated 6 years ago
- ☆10Apr 29, 2024Updated 2 years ago
- ☆14May 25, 2022Updated 4 years ago
- The implementation of FedBCD algorithm published in the paper "FedBCD: A Communication-Efficient Collaborative Learning Framework for Dis…☆16Jul 2, 2024Updated 2 years ago
- Package speculatively provides a simple mechanism to re-execute a task in parallel only after some initial timeout has elapsed.☆10Jul 11, 2025Updated last year
- CoLa - Decentralized Linear Learning: https://arxiv.org/abs/1808.04883☆21Nov 30, 2021Updated 4 years ago
- DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation☆16Jul 13, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆33Feb 10, 2023Updated 3 years ago
- ☆11Jan 2, 2022Updated 4 years ago
- ☆10Mar 31, 2025Updated last year
- A Benchmark of Real-world Image Dataset for Federated Learning☆42Oct 9, 2019Updated 7 years ago
- Easy-to-Use Federated Learning Simulator in Pytorch☆17Apr 23, 2021Updated 5 years ago
- Data Driven Dynamic Hybrid Renewable Energy design and simulation framework☆12May 5, 2020Updated 6 years ago
- Code for paper "Byzantine-Resilient Distributed Finite-Sum Optimization over Networks"☆20Nov 5, 2020Updated 5 years ago
- Dynamic Weighted Majority for Imbalance Learning☆15Nov 4, 2019Updated 6 years ago
- ☆22Apr 6, 2021Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆27Aug 25, 2023Updated 3 years ago
- Complete simulation of IEEE 754 fixed and floating point specification to any precision☆13Aug 26, 2020Updated 6 years ago
- This code was finished before source code hasn't been released.☆27Nov 18, 2019Updated 6 years ago
- ☆38Jan 15, 2021Updated 5 years ago
- FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.☆193Apr 11, 2025Updated last year
- This repo contains the code used for NeurIPS 2019 paper "Asymmetric Valleys: Beyond Sharp and Flat Local Minima".☆14Oct 25, 2019Updated 6 years ago
- How to use AWS IoT Greengrass V2 for Image classification and Video Analytics Pipelines☆20May 21, 2021Updated 5 years ago
- Implementation of Parameter Server using PyTorch communication lib☆41Apr 7, 2019Updated 7 years ago
- Fully Decoupled Neural Network Learning Using Delayed Gradients (FDG)☆21Jul 5, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆10Sep 7, 2022Updated 4 years ago
- SKFAC Preconditioner for MindSpore☆12Jul 2, 2021Updated 5 years ago
- Unofficial implementation of the Ask-LLM paper 'How to Train Data-Efficient LLMs', arXiv:2402.09668.☆13Jun 19, 2024Updated 2 years ago
- [NeurIPS'22 Spotlight] Federated Learning from Pre-Trained Models: A Contrastive Learning Approach☆44Apr 25, 2023Updated 3 years ago
- A fast data loader for ImageNet on PyTorch.☆18Mar 17, 2019Updated 7 years ago
- This is the code for "TARGET: Federated Class-Continual Learning via Exemplar-Free Distillation" (ICCV 2023)☆52Apr 30, 2024Updated 2 years ago
- DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization☆12Jun 15, 2022Updated 4 years ago