Understanding Top-k Sparsification in Distributed Deep Learning
☆24Nov 15, 2019Updated 6 years ago
Alternatives and similar repositories for GaussianK-SGD
Users that are interested in GaussianK-SGD are comparing it to the libraries listed below
Sorting:
- vector quantization for stochastic gradient descent.☆35May 12, 2020Updated 5 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- [ICLR 2018] Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training☆226Jul 10, 2024Updated last year
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Nov 14, 2021Updated 4 years ago
- Layer-wise Sparsification of Distributed Deep Learning☆10Jul 6, 2020Updated 5 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆139Jul 23, 2024Updated last year
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆27Dec 10, 2022Updated 3 years ago
- SGD with compressed gradients and error-feedback: https://arxiv.org/abs/1901.09847☆32Jul 25, 2024Updated last year
- AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION☆14Oct 27, 2023Updated 2 years ago
- Code for paper: Variance Reduced Local SGD with Lower Communication Complexity☆12May 20, 2020Updated 5 years ago
- ☆33Dec 3, 2019Updated 6 years ago
- gTop-k S-SGD: A Communication-Efficient Distributed Synchronous SGD Algorithm for Deep Learning☆37Aug 19, 2019Updated 6 years ago
- SJTU HPC 开源项目：Spackenv (Spack ENVironment) switch environments between sysadmin, users and developers.☆22Jan 4, 2022Updated 4 years ago
- Ternary Gradients to Reduce Communication in Distributed Deep Learning (TensorFlow)☆182Nov 19, 2018Updated 7 years ago
- Code for "Adaptive Gradient Quantization for Data-Parallel SGD", published in NeurIPS 2020.☆30Jan 14, 2021Updated 5 years ago
- Implementation of (overlap) local SGD in Pytorch☆34Jul 12, 2020Updated 5 years ago
- 这是一个使用vue配合element-ui开发的一个电商后台管理系统项目，项目都都是使用的前端最新技术☆13Jan 4, 2023Updated 3 years ago
- A tool designed to compare energy and emission costs between computer chips☆13Dec 9, 2023Updated 2 years ago
- [CCS 2021] "DataLens: Scalable Privacy Preserving Training via Gradient Compression and Aggregation" by Boxin Wang*, Fan Wu*, Yunhui Long…☆36Dec 28, 2021Updated 4 years ago
- ☆12Jan 5, 2026Updated 2 months ago
- Multimodal SuperCon: Classifier for Drivers of Deforestation in Indonesia☆10Nov 18, 2023Updated 2 years ago
- ☆12Oct 28, 2023Updated 2 years ago
- Framework for geospatial research CNN development.☆11Apr 10, 2021Updated 4 years ago
- Code for the signSGD paper☆93Jan 12, 2021Updated 5 years ago
- ☆14Updated this week
- PyFed generic framework of benchmark for Federated Learning☆11Oct 9, 2021Updated 4 years ago
- ☆10Jun 26, 2023Updated 2 years ago
- 🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.☆13Jan 30, 2026Updated last month
- [ICLR 2022] Boosting Randomized Smoothing with Variance Reduced Classifiers☆12Mar 29, 2022Updated 3 years ago
- Code for paper "Towards Efficient Pareto Set Approximation via Weight-Ensembling Mixture of Experts"☆11Sep 13, 2024Updated last year
- Code for NeurIPS 2019 paper "Screening Sinkhorn Algorithm for Regularized Optimal Transport"☆10Feb 10, 2020Updated 6 years ago
- 毕业通讯录，同学间的通讯录。基于微信公众平台的通讯录☆11May 31, 2013Updated 12 years ago
- Github Repo for ICML 2022 paper: Communication-Efficient Adaptive Federated Learning☆10Nov 18, 2022Updated 3 years ago
- Imports OpenStreetMap data into a Neo4j graph database. Produces a simple schema that includes nodes, ways, and all properties/tags conta…☆11Apr 14, 2023Updated 2 years ago
- Code for Neural Networks journal paper - StoCFL: A stochastically clustered federated learning framework for Non-IID data with dynamic cl…☆12Apr 28, 2024Updated last year
- Framework for Algorithmic Correctness Testing of Operators☆16Updated this week
- Teaching a Convolutional Neural Network to recognize painting genre. Handcrafted dataset. Cool visualizations.☆10Dec 19, 2018Updated 7 years ago
- Code for paper "Learning a Code: Machine Learning for Approximate Non-Linear Coded-Computation"☆11Dec 21, 2020Updated 5 years ago
- ☆12Aug 19, 2022Updated 3 years ago