☆46Mar 4, 2020Updated 5 years ago
Alternatives and similar repositories for LocalSGD-Code
Users that are interested in LocalSGD-Code are comparing it to the libraries listed below
Sorting:
- Implementation of (overlap) local SGD in Pytorch☆34Jul 12, 2020Updated 5 years ago
- Decentralized SGD and Consensus with Communication Compression: https://arxiv.org/abs/1907.09356☆75Sep 10, 2020Updated 5 years ago
- Accelerating Transfer Learning with Robust Neural Nets☆11Oct 2, 2020Updated 5 years ago
- Early exit ensembles☆12Dec 4, 2021Updated 4 years ago
- Source code of ICLR2020 submisstion: Zeno++: Robust Fully Asynchronous SGD☆14Feb 2, 2020Updated 6 years ago
- Official code for Guiding Language Model Math Reasoning with Planning Tokens☆18Feb 29, 2024Updated 2 years ago
- MG-WFBP: Merging Gradients Wisely for Efficient Communication in Distributed Deep Learning☆12Apr 26, 2021Updated 4 years ago
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated last year
- Code related to ’Beyond spectral gap: The role of the topology in decentralized learning‘.☆13Jun 7, 2022Updated 3 years ago
- Stochastic Gradient Push for Distributed Deep Learning☆171Apr 5, 2023Updated 2 years ago
- Code for "Practical Low-Rank Communication Compression in Decentralized Deep Learning"☆17Aug 4, 2020Updated 5 years ago
- source code of AISTATS 2020 paper: Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphs☆12Jun 21, 2022Updated 3 years ago
- Code for paper "Byzantine-Resilient Decentralized Stochastic Optimization with Robust Aggregation Rules"☆20Apr 19, 2024Updated last year
- MLBench Framework Core Python Library☆18Mar 1, 2023Updated 2 years ago
- PyTorch-MPI-DDP-example☆18Mar 21, 2018Updated 7 years ago
- vector quantization for stochastic gradient descent.☆35May 12, 2020Updated 5 years ago
- ddl-benchmarks: Benchmarks for Distributed Deep Learning☆36May 29, 2020Updated 5 years ago
- A fast data loader for ImageNet on PyTorch.☆18Mar 17, 2019Updated 6 years ago
- Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727☆149Oct 29, 2024Updated last year
- Relative gradient optimization of the Jacobian term in unsupervised deep learning, NeurIPS 2020☆21Apr 27, 2021Updated 4 years ago
- ☆30Jun 19, 2023Updated 2 years ago
- [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf☆25Nov 14, 2023Updated 2 years ago
- Code for the signSGD paper☆93Jan 12, 2021Updated 5 years ago
- The pytorch code of FedDISC (Federated Diffusion-Inspired Semi-supervised Co-training method)☆11Sep 3, 2023Updated 2 years ago
- GRACE - GRAdient ComprEssion for distributed deep learning☆139Jul 23, 2024Updated last year
- Resource Efficient Federated Learning☆25Jan 13, 2023Updated 3 years ago
- PyTorch implementation of FIM and empirical FIM☆60Jul 10, 2018Updated 7 years ago
- The repository contains code for Adaptive Data Optimization☆32Dec 9, 2024Updated last year
- Find out which countries have won the most medals and how the participation of nations has changed over time, with R☆10Aug 22, 2021Updated 4 years ago
- gossip: Efficient Communication Primitives for Multi-GPU Systems☆62Jul 1, 2022Updated 3 years ago
- Implementation of Neural Episodic Control in Tensorflow☆27May 16, 2019Updated 6 years ago
- Sharpness-Aware Minimization Leads to Low-Rank Features [NeurIPS 2023]☆29Sep 22, 2023Updated 2 years ago
- Sparsified SGD with Memory: https://arxiv.org/abs/1809.07599☆58Oct 25, 2018Updated 7 years ago
- [NeurIPS 2019] H. Chen*, H. Zhang*, S. Si, Y. Li, D. Boning and C.-J. Hsieh, Robustness Verification of Tree-based Models (*equal contrib…☆27Jun 15, 2019Updated 6 years ago
- ☆22Apr 6, 2021Updated 4 years ago
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆30Jun 6, 2024Updated last year
- Official code for "In Search of Robust Measures of Generalization" (NeurIPS 2020)☆28Dec 22, 2020Updated 5 years ago
- ☆25Apr 13, 2021Updated 4 years ago
- CurriculumNet: Weakly Supervised Learning from Large-Scale Web Images☆29Oct 9, 2018Updated 7 years ago