We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We empirically evaluate the performance of the compression methods by training deep neural networks on the CIFAR10 dataset.
☆10Nov 14, 2021Updated 5 years ago
Alternatives and similar repositories for Gradient-Compression
Users that are interested in Gradient-Compression are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Dec 3, 2019Updated 6 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- Network-Accelerated Distributed Deep Learning☆10Sep 13, 2021Updated 5 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 5 years ago
- ☆10Jun 4, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- FedShare: Secure Aggregation based on Additive Secret Sharing in Federated Learning☆21Oct 20, 2026Updated 3 weeks ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 5 years ago
- Q-RR, DIANA-RR, Q-NASTYA, NASTYA-DIANA, QSGD, DIANA, FedCOM and FedPAQ on logistic loss with L2 regularization☆11Nov 1, 2022Updated 4 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆141Jul 23, 2024Updated 2 years ago
- vector quantization for stochastic gradient descent.☆38May 12, 2020Updated 6 years ago
- SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantization☆12Aug 12, 2020Updated 6 years ago
- ☆17May 10, 2024Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [PoPETS 2024] Source code of FedLAP-DP: Federated Learning by Sharing Differentially Private Loss Approximations☆11Jul 3, 2024Updated 2 years ago
- ☆15Jul 13, 2021Updated 5 years ago
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Sep 21, 2023Updated 3 years ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆33Nov 11, 2023Updated 3 years ago
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 7 years ago
- CIFAR-10 image classification of imbalanced data using bottleneck features extracted from the autoencoder.☆10Sep 26, 2019Updated 7 years ago
- FedCS:Coreset selection for Federated Learning (CVPR2025)☆11Oct 22, 2026Updated 3 weeks ago
- The source code of the paper "Efficient Privacy-Preserving Federated Learning with Compressed Sensing"☆21May 23, 2024Updated 2 years ago
- Efficient Secure Aggregation for Privacy-Preserving Federated Machine Learning (ACSAC 2024)☆15Aug 21, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- PyFed generic framework of benchmark for Federated Learning☆11Oct 9, 2021Updated 5 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Dec 8, 2022Updated 3 years ago
- 本地优先的口播视频剪辑工作台与 CLI☆18Oct 26, 2026Updated 3 weeks ago
- ☆12Aug 22, 2023Updated 3 years ago
- Official implementation of "Private Set Generation with Discriminative Information" (NeurIPS 2022)☆18Aug 14, 2023Updated 3 years ago
- Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realization☆13Jun 21, 2021Updated 5 years ago
- Accepted at MLNCP NeurIPS 2024: QFed+FHE: Quantum Federated Learning with Secure Fully Homomorphic Encryption (FHE)☆15Dec 27, 2024Updated last year
- Custom SpMM operations integrated into PyTorch☆11Apr 15, 2022Updated 4 years ago
- Code for paper "Learning a Code: Machine Learning for Approximate Non-Linear Coded-Computation"☆10Dec 21, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Asynchronous ADMM for Consensus Optimization☆11Dec 7, 2020Updated 5 years ago
- ☆10Apr 19, 2021Updated 5 years ago
- Codes for paper "ALI-DPFL: Differentially Private Federated Learning with Adaptive Local Iterations"☆17May 22, 2024Updated 2 years ago
- [MICCAI2023] Client-Level Differential Privacy via Adaptive Intermediary in Federated Medical Imaging☆17Aug 2, 2024Updated 2 years ago
- ☆14Oct 1, 2026Updated last month
- Natural Language Processing models using private and secure data. Powered by OpenMined's tools PySyft and SyferText.☆11Feb 11, 2021Updated 5 years ago
- 这是一个使用vue配合element-ui开发的一个电商后台管理系统项目,项目都都是使用的前端最新技术☆13Jan 4, 2023Updated 3 years ago
Are these results useful?