gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning
☆37Aug 19, 2019Updated 7 years ago
Alternatives and similar repositories for gtopkssgd
Users that are interested in gtopkssgd are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847☆31Jul 25, 2024Updated 2 years ago
- It is implementation of Research paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING". Deep g…☆18Aug 14, 2019Updated 7 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 8 years ago
- Atomo: Communication-efficient Learning via Atomic Sparsification☆29Dec 9, 2018Updated 7 years ago
- Simple Hierarchical Count Sketch in Python☆21Jun 3, 2021Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Layer-wise Sparsification of Distributed Deep Learning☆10Jul 6, 2020Updated 6 years ago
- PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms☆80Aug 30, 2021Updated 5 years ago
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆36May 29, 2020Updated 6 years ago
- Partial implementation of paper "DEEP GRADIENT COMPRESSION: REDUCING THE COMMUNICATION BANDWIDTH FOR DISTRIBUTED TRAINING"☆33Nov 20, 2020Updated 5 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆74Sep 10, 2020Updated 6 years ago
- A computation-parallel deep learning architecture.☆13Sep 25, 2019Updated 7 years ago
- Byzantine-resilient distributed SGD with TensorFlow.☆40Jan 22, 2021Updated 5 years ago
- A compressed adaptive optimizer for training large-scale deep learning models using PyTorch☆25Nov 26, 2019Updated 6 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆141Jul 23, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning☆12Apr 26, 2021Updated 5 years ago
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- A decentralised application that creates high quality machine learning datasets☆12Jan 22, 2019Updated 7 years ago
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- ☆77Jun 7, 2019Updated 7 years ago
- A Deep Learning Meta-Framework and HPC Benchmarking Library☆82May 23, 2022Updated 4 years ago
- Algorithm: Decentralized Parallel Stochastic Gradient Descent☆48Sep 2, 2018Updated 8 years ago
- Code for paper: Variance Reduced Local SGD with Lower Communication Complexity☆12May 20, 2020Updated 6 years ago
- ☆46Mar 4, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆22Jun 5, 2019Updated 7 years ago
- Multi-Agent training using Deep Deterministic Policy Gradient Networks, Solving the Tennis Environment☆11Oct 20, 2018Updated 8 years ago
- Communication-efficient decentralized SGD (Pytorch)☆23Mar 17, 2020Updated 6 years ago
- ☆42Feb 9, 2020Updated 6 years ago
- Research simulation toolkit for federated learning☆14Nov 7, 2020Updated 6 years ago
- divide-and-conquer eigenvalues algorithm for symmetric tridiagonal matrix, designed by Cuppen☆17Mar 1, 2020Updated 6 years ago
- ☆10Nov 11, 2022Updated 4 years ago
- Network-Accelerated Distributed Deep Learning☆10Sep 13, 2021Updated 5 years ago
- Code for "On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Length", ICLR 2019☆11Dec 8, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Sep 23, 2023Updated 3 years ago
- ☆29Oct 22, 2020Updated 6 years ago
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Nov 14, 2021Updated 5 years ago
- Argobots bindings for the Mercury RPC library☆27Nov 11, 2026Updated last week
- QSFL: A Two-Level Uplink Communication Optimization Framework for Federated Learning (ICML'22)☆13Jul 26, 2023Updated 3 years ago
- notes on reading tensorflow source code☆13Aug 18, 2018Updated 8 years ago
- flexible-gemm conv of deepcore☆17Dec 2, 2019Updated 6 years ago
Are these results useful?