Implementation of (overlap) local SGD in Pytorch
☆34Jul 12, 2020Updated 6 years ago
Alternatives and similar repositories for Overlap_Local_SGD
Users that are interested in Overlap_Local_SGD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆74Sep 10, 2020Updated 5 years ago
- vector quantization for stochastic gradient descent.☆37May 12, 2020Updated 6 years ago
- The implementation of "Continual Local Training for Better Initialization of Federated Models" (ICIP 2020).☆16May 27, 2020Updated 6 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- Dual-way gradient sparsification approach for async DNN training, based on PyTorch.☆10Dec 8, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Accuracy 77%. Large batch deep learning optimizer LARS for ImageNet with PyTorch and ResNet, using Horovod for distribution. Optional acc…☆38Jun 1, 2021Updated 5 years ago
- Repository that contains the code for the paper titled, 'Unifying Distillation with Personalization in Federated Learning'.☆14May 31, 2021Updated 5 years ago
- FuseFL: One-Shot Federated Learning through the Lens of Causality with Progressive Model Fusion (NeurIPS 2024 Spotlight)☆15Mar 31, 2025Updated last year
- "Layer-wise Adaptive Rate Scaling" in PyTorch☆86Jan 22, 2021Updated 5 years ago
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- ☆26Apr 3, 2020Updated 6 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Nov 14, 2021Updated 4 years ago
- Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727☆151Oct 29, 2024Updated last year
- ☆14May 25, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Associated codebase for Byzantine-resilient distributed / decentralized machine learning papers from INSPIRE Lab☆14Oct 11, 2021Updated 4 years ago
- Code for the signSGD paper☆95Jan 12, 2021Updated 5 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆141Jul 23, 2024Updated 2 years ago
- DETOX: A Redundancy-based Framework for Faster and More Robust Gradient Aggregation☆16Jul 13, 2020Updated 6 years ago
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- ☆34Feb 10, 2023Updated 3 years ago
- [ICASSP 2024] VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders☆17Feb 11, 2025Updated last year
- A Benchmark of Real-world Image Dataset for Federated Learning☆42Oct 9, 2019Updated 6 years ago
- "What is Learned in Visually Grounded Neural Syntax Acquisition", Noriyuki Kojima, Hadar Averbuch-Elor, Alexander Rush and Yoav Artzi (AC…☆12Dec 30, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for ICLR 2023 Paper Better Generative Replay for Continual Federated Learning☆34Apr 23, 2023Updated 3 years ago
- Code Release for "On the Inductive Bias of Masked Language Modeling: From Statistical to Syntactic Dependencies"☆16Apr 13, 2021Updated 5 years ago
- ☆21Oct 6, 2021Updated 4 years ago
- Personalized Federated Learning with Moreau Envelopes (pFedMe) using Pytorch (NeurIPS 2020)☆310Apr 18, 2022Updated 4 years ago
- Dynamic Weighted Majority for Imbalance Learning☆15Nov 4, 2019Updated 6 years ago
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 4 years ago
- Companion code to the preprint: E Bıyık, K Wang, N Anari, D Sadigh, "Batch Active Learning using Determinantal Point Processes". arXiv pr…☆14Jul 25, 2024Updated 2 years ago
- summer school materials☆46Aug 4, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆27Aug 25, 2023Updated 3 years ago
- ☆39Jan 15, 2021Updated 5 years ago
- ZOSVRG-BlackBox-Adv☆12Oct 30, 2018Updated 7 years ago
- PyTorch implementation of FedNova (NeurIPS 2020), and a class of federated learning algorithms, including FedAvg, FedProx.☆229Oct 21, 2020Updated 5 years ago
- The art of github contributions heatmap.☆29Sep 23, 2021Updated 4 years ago
- a high performance system for customized-precision distributed deep learning☆12Dec 10, 2020Updated 5 years ago
- FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.☆194Apr 11, 2025Updated last year