vector quantization for stochastic gradient descent.
☆35May 12, 2020Updated 5 years ago
Alternatives and similar repositories for gradient-quantization
Users that are interested in gradient-quantization are comparing it to the libraries listed below
Sorting:
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- Implementation of Compressed SGD with Compressed Gradients in Pytorch☆13Jul 25, 2024Updated last year
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆139Jul 23, 2024Updated last year
- It is implementation of Research paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING". Deep g…☆18Aug 14, 2019Updated 6 years ago
- Atomo: Communication-efficient Learning via Atomic Sparsification☆28Dec 9, 2018Updated 7 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- ☆33Dec 3, 2019Updated 6 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Nov 14, 2021Updated 4 years ago
- Partial implementation of paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING"☆32Nov 20, 2020Updated 5 years ago
- Code for AISTATS'25 paper - On the Power of Adaptive Weighted Aggregation in Heterogeneous Federated Learning and Beyond☆13Sep 23, 2025Updated 5 months ago
- Research simulation toolkit for federated learning☆13Nov 7, 2020Updated 5 years ago
- Code for the signSGD paper☆93Jan 12, 2021Updated 5 years ago
- ☆12Jul 16, 2020Updated 5 years ago
- Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)☆182Nov 19, 2018Updated 7 years ago
- [ICLR 2018] Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training☆226Jul 10, 2024Updated last year
- Speech recognition with federated learning☆11Jan 9, 2020Updated 6 years ago
- ☆21Oct 25, 2021Updated 4 years ago
- Simplicial-FL to manage client device heterogeneity in Federated Learning☆22Aug 3, 2023Updated 2 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆75Sep 10, 2020Updated 5 years ago
- FedCD: Improving Performance in non-IID Federated Learning☆14Dec 2, 2020Updated 5 years ago
- Efficient approximation algorithms for Shapley Values in Horizontal Enterprise Federated Learning☆13May 5, 2020Updated 5 years ago
- ☆22Apr 6, 2021Updated 4 years ago
- Official implementation of "GRNN: Generative Regression Neural Network - A Data Leakage Attack for Federated Learning"☆33Feb 28, 2022Updated 4 years ago
- Federated Learning over Wireless Networks: Convergence Analysis and Resource Allocation☆35Sep 24, 2021Updated 4 years ago
- [NeurIPS‘2021] "MEST: Accurate and Fast Memory-Economic Sparse Training Framework on the Edge", Geng Yuan, Xiaolong Ma, Yanzhi Wang et al…☆17Mar 16, 2022Updated 4 years ago
- ☆26Apr 3, 2020Updated 5 years ago
- FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.☆193Apr 11, 2025Updated 11 months ago
- SPATL: Salient Prameter Aggregation and Transfer Learning for Heterogeneous Federated Learning☆23Nov 17, 2022Updated 3 years ago
- PyTorch implementation of Joint Privacy Enhancement and Quantization in Federated Learning (IEEE TSP 2023, IEEE ICASSP 2023, IEEE ISIT 20…☆18Oct 28, 2025Updated 4 months ago
- Federated Learning package☆21Aug 16, 2021Updated 4 years ago
- Implementation of EF and EF21 methods and their comparison on several tasks☆10Feb 24, 2024Updated 2 years ago
- FedDANE: A Federated Newton-Type Method (Asilomar Conference on Signals, Systems, and Computers ‘19)☆26Mar 24, 2023Updated 2 years ago
- Code for the paper "Faster Neural Network Training with Approximate Tensor Operations"☆10Oct 23, 2021Updated 4 years ago
- Normalization Matters in Weakly Supervised Object Localization (ICCV 2021)☆11Oct 24, 2021Updated 4 years ago
- Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727☆149Oct 29, 2024Updated last year
- Code for paper "Byzantine-Resilient Distributed Finite-Sum Optimization over Networks"☆18Nov 5, 2020Updated 5 years ago
- ☆23Apr 7, 2022Updated 3 years ago
- ☆46Mar 4, 2020Updated 6 years ago