We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We empirically evaluate the performance of the compression methods by training deep neural networks on the CIFAR10 dataset.
☆10Nov 14, 2021Updated 4 years ago
Alternatives and similar repositories for Gradient-Compression
Users that are interested in Gradient-Compression are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32Dec 3, 2019Updated 6 years ago
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 3 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 4 years ago
- FedShare: Secure Aggregation based on Additive Secret Sharing in Federated Learning☆21Oct 20, 2026Updated last week
- ☆10Jun 4, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 5 years ago
- Q-RR, DIANA-RR, Q-NASTYA, NASTYA-DIANA, QSGD, DIANA, FedCOM and FedPAQ on logistic loss with L2 regularization☆11Nov 1, 2022Updated 3 years ago
- vector quantization for stochastic gradient descent.☆38May 12, 2020Updated 6 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆141Jul 23, 2024Updated 2 years ago
- SGQuant: Squeezing the Last Bit on Graph Neural Networks with Specialized Quantization☆11Aug 12, 2020Updated 6 years ago
- [PoPETS 2024] Source code of FedLAP-DP: Federated Learning by Sharing Differentially Private Loss Approximations☆11Jul 3, 2024Updated 2 years ago
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Sep 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆17May 10, 2024Updated 2 years ago
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆33Nov 11, 2023Updated 2 years ago
- Efficient Secure Aggregation for Privacy-Preserving Federated Machine Learning (ACSAC 2024)☆15Aug 21, 2025Updated last year
- The source code of the paper "Efficient Privacy-Preserving Federated Learning with Compressed Sensing"☆21May 23, 2024Updated 2 years ago
- ☆15Jul 13, 2021Updated 5 years ago
- CIFAR-10 image classification of imbalanced data using bottleneck features extracted from the autoencoder.☆10Sep 26, 2019Updated 7 years ago
- PyFed generic framework of benchmark for Federated Learning☆11Oct 9, 2021Updated 5 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Dec 8, 2022Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- robo-harness k1: tool-augmented visual robot control for LIBERO-Pro and RoboSuite☆20Sep 28, 2026Updated last month
- ☆12Aug 22, 2023Updated 3 years ago
- 本地优先的口播视频剪辑工作台与 CLI☆17Updated this week
- Official implementation of "Private Set Generation with Discriminative Information" (NeurIPS 2022)☆18Aug 14, 2023Updated 3 years ago
- [MICCAI2023] Client-Level Differential Privacy via Adaptive Intermediary in Federated Medical Imaging☆17Aug 2, 2024Updated 2 years ago
- Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realization☆13Jun 21, 2021Updated 5 years ago
- Artifacts of VLDB'22 paper "COMET: A Novel Memory-Efficient Deep Learning TrainingFramework by Using Error-Bounded Lossy Compression"☆10Aug 2, 2022Updated 4 years ago
- Accepted at MLNCP NeurIPS 2024: QFed+FHE: Quantum Federated Learning with Secure Fully Homomorphic Encryption (FHE)☆15Dec 27, 2024Updated last year
- Code for paper "Learning a Code: Machine Learning for Approximate Non-Linear Coded-Computation"☆10Dec 21, 2020Updated 5 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- SC 2021, "LogECMem: Coupling Erasure-Coded In-Memory Key-Value Stores with Parity Logging"☆12Jul 12, 2021Updated 5 years ago
- Asynchronous ADMM for Consensus Optimization☆11Dec 7, 2020Updated 5 years ago
- ☆10Apr 19, 2021Updated 5 years ago
- Codes for paper "ALI-DPFL: Differentially Private Federated Learning with Adaptive Local Iterations"☆17May 22, 2024Updated 2 years ago
- An attempt to replicate the paper "Multi-shot Pedestrian Re-identification via Sequential Decision Making (CVPR2018)"☆10Nov 16, 2019Updated 6 years ago
- Local MCP bridge server that turns ChatGPT into a Codex-like coding agent☆30Sep 17, 2026Updated last month
- SOTA results for reid baseline model (Gluon implementation)☆13Aug 6, 2018Updated 8 years ago