We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We empirically evaluate the performance of the compression methods by training deep neural networks on the CIFAR10 dataset.
☆10Nov 14, 2021Updated 4 years ago
Alternatives and similar repositories for Gradient-Compression
Users that are interested in Gradient-Compression are comparing it to the libraries listed below
Sorting:
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 2 years ago
- ☆10Jun 4, 2021Updated 4 years ago
- Code for reproducing experiments performed for Accoridon☆13Jun 11, 2021Updated 4 years ago
- A Sparse-tensor Communication Framework for Distributed Deep Learning☆13Nov 1, 2021Updated 4 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- Hi-Speed DNN Training with Espresso: Unleashing the Full Potential of Gradient Compression with Near-Optimal Usage Strategies (EuroSys '2…☆15Sep 21, 2023Updated 2 years ago
- ☆17May 10, 2024Updated last year
- ☆33Dec 3, 2019Updated 6 years ago
- ☆15Jul 13, 2021Updated 4 years ago
- FedShare: Secure Aggregation based on Additive Secret Sharing in Federated Learning☆21Jan 15, 2026Updated last month
- The source code of the paper "Efficient Privacy-Preserving Federated Learning with Compressed Sensing"☆22May 23, 2024Updated last year
- GRACE - GRAdient ComprEssion for distributed deep learning☆139Jul 23, 2024Updated last year
- Understanding Top-k Sparsification in Distributed Deep Learning☆24Nov 15, 2019Updated 6 years ago
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- Secure Aggregation for FL☆38Nov 25, 2023Updated 2 years ago
- GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)☆34Nov 11, 2023Updated 2 years ago
- 这是一个使用vue配合element-ui开发的一个电商后台管理系统项目，项目都都是使用的前端最新技术☆13Jan 4, 2023Updated 3 years ago
- vector quantization for stochastic gradient descent.☆35May 12, 2020Updated 5 years ago
- [CCS 2021] "DataLens: Scalable Privacy Preserving Training via Gradient Compression and Aggregation" by Boxin Wang*, Fan Wu*, Yunhui Long…☆36Dec 28, 2021Updated 4 years ago
- ☆16Feb 22, 2025Updated last year
- Code accompanying the NeurIPS 2019 paper AutoAssist: A Framework to Accelerate Training of Deep Neural Networks.☆14Oct 3, 2022Updated 3 years ago
- netbeacon - monitoring your network capture, NIDS or network analysis process☆19Oct 26, 2013Updated 12 years ago
- code for polite☆11Feb 28, 2024Updated 2 years ago
- A collection of heat engines, based on the OpenAI Gym environment framework for use with reinforcement learning applications.☆15Dec 20, 2021Updated 4 years ago
- DreamSmooth: Improving Model-Based RL with Reward Smoothing (ICLR 2024)☆12May 6, 2024Updated last year
- Teaching a humanoid to walk(ish), then displaying in your browser (using tensorflow.js and reinforcement learning)☆10Sep 7, 2020Updated 5 years ago
- The code for the paper "A Bayesian Approach to Online Planning" published in ICML 2024.☆13Jun 17, 2024Updated last year
- ☆11Jan 11, 2022Updated 4 years ago
- About Code release for "Imagination Mechanism: Mesh Information Propagation for Enhancing Data Efficiency in Reinforcement Learning"☆13Oct 7, 2023Updated 2 years ago
- ☆14Mar 21, 2024Updated last year
- ☆10Jun 21, 2024Updated last year
- ☆10Jun 28, 2025Updated 7 months ago
- Isaac Gym Reinforcement Learning Environments for humanoid robot Bez☆10Jul 27, 2022Updated 3 years ago
- Jieba 0.39 的 Java 复刻版，支持原版 Jieba 的所有核心功能☆12Feb 14, 2019Updated 7 years ago
- Official Code Repo for the paper "Learning to Play Atari in a World of Tokens" accepted at ICML, 2024☆11Jun 6, 2024Updated last year
- unifloc on python☆15Nov 14, 2020Updated 5 years ago
- ☆10Sep 14, 2023Updated 2 years ago
- ☆12Aug 19, 2022Updated 3 years ago
- FPGA-based HyperLogLog Accelerator☆12Jul 13, 2020Updated 5 years ago