☆33Dec 3, 2019Updated 6 years ago
Alternatives and similar repositories for Gradient-Compression-Methods
Users that are interested in Gradient-Compression-Methods are comparing it to the libraries listed below
Sorting:
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Nov 14, 2021Updated 4 years ago
- Implementation of Compressed SGD with Compressed Gradients in Pytorch☆13Jul 25, 2024Updated last year
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- The code for the paper "QuAFL: Federated Averaging Can Be Both Asynchronous and Communication-Efficient"☆17Mar 26, 2023Updated 2 years ago
- vector quantization for stochastic gradient descent.☆35May 12, 2020Updated 5 years ago
- Code for the signSGD paper☆93Jan 12, 2021Updated 5 years ago
- ☆12Jul 16, 2020Updated 5 years ago
- Artifacts of VLDB'22 paper "COMET: A Novel Memory-Efficient Deep Learning TrainingFramework by Using Error-Bounded Lossy Compression"☆10Aug 2, 2022Updated 3 years ago
- ☆10Jul 21, 2021Updated 4 years ago
- An implementation of FedPAQ using different experimental parameters. We will be looking at different variations of how, r(number of clien…☆23Apr 3, 2021Updated 4 years ago
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- Implementation of FedDR algorithm for federated learning.☆11Mar 8, 2022Updated 3 years ago
- Implementation of (overlap) local SGD in Pytorch☆34Jul 12, 2020Updated 5 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆75Sep 10, 2020Updated 5 years ago
- [ICLR 2018] Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training☆226Jul 10, 2024Updated last year
- Code for the COLING 2022 paper "DoubleMix: Simple Interpolation-Based Data Augmentation for Text Classification"☆19Oct 19, 2022Updated 3 years ago
- It is implementation of Research paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING". Deep g…☆18Aug 14, 2019Updated 6 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆139Jul 23, 2024Updated last year
- ☆22Jul 20, 2022Updated 3 years ago
- ICLR2023 statistics☆59Nov 11, 2023Updated 2 years ago
- A Comprehensive and Versatile Open-Source Federated Learning Framework☆33Apr 3, 2023Updated 2 years ago
- PyTorch implementation of SCAFFOLD (Stochastic Controlled Averaging for Federated Learning, ICML 2020).☆70Jun 28, 2022Updated 3 years ago
- ☆54Jun 22, 2021Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- Code for paper "Adaptive Federated Learning in Resource Constrained Edge Computing Systems"☆293May 7, 2025Updated 9 months ago
- SCAFFOLD and FedAvg implementation☆61Jul 20, 2021Updated 4 years ago
- ☆33May 14, 2022Updated 3 years ago
- [ICML 2024] Official Repository for the paper "Transformers Get Stable: An End-to-End Signal Propagation Theory for Language Models"☆10Jul 19, 2024Updated last year
- A python algorithm to change the pitch of the voice in real time☆13Dec 13, 2020Updated 5 years ago
- ☆17Mar 22, 2025Updated 11 months ago
- Neural Distributed Image Compression using Common Information (NDIC) [DCC 2022]☆35Jul 10, 2022Updated 3 years ago
- gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning☆37Aug 19, 2019Updated 6 years ago
- A toolkit for constructing schedule-abstraction graph in Python☆12Feb 7, 2025Updated last year
- DADAM: A Consensus-based Distributed Adaptive Gradient Method for Online Optimization☆11Jun 15, 2022Updated 3 years ago
- (READ ONLY MIRROR) The ProB Model Checker and Animator Plugin for Rodin☆19Updated this week
- SKFAC Preconditioner for MindSpore☆12Jul 2, 2021Updated 4 years ago
- QROA: A Black-Box Query-Response Optimization Attack on LLMs☆14May 23, 2025Updated 9 months ago
- my solution for UC Berkeley AI projects pacman☆11Jul 25, 2020Updated 5 years ago
- ☆43Dec 8, 2021Updated 4 years ago