orion-orion / Distributed-ML-PySparkLinks
🔨 使用Spark/Pytorch实现分布式算法,包括图/矩阵计算(graph/matrix computation)、随机算法、优化(optimization)和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程
☆38Updated last year
Alternatives and similar repositories for Distributed-ML-PySpark
Users that are interested in Distributed-ML-PySpark are comparing it to the libraries listed below
Sorting:
- 中科大凌青老师凸优化课程的课程笔记☆31Updated 4 years ago
- ☆19Updated 2 years ago
- The code for the paper "QuAFL: Federated Averaging Can Be Both Asynchronous and Communication-Efficient"☆17Updated 2 years ago
- Papers related to federated learning for recommender system☆32Updated 4 years ago
- FedAI 社区中文文档☆135Updated last year
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆33Updated last year
- We present a set of all-reduce compatible gradient compression algorithms which significantly reduce the communication overhead while mai…☆10Updated 3 years ago
- 🔨 A toolbox for federated learning, aiming to provide implementations of FedAvg, FedProx, Ditto, etc. in multiple versions, such as Pyto…☆67Updated last year
- A tree-based federated learning system (MLSys 2023)☆147Updated 4 months ago
- A computation-parallel deep learning architecture.☆13Updated 5 years ago
- Tutorials and paper lists for federated learning☆67Updated 3 years ago
- ☆24Updated last week
- 🔬 FedCom为SWPU2022届本科毕业设计《基于社区检测的多任务聚类联邦学习》。本研究提出了一种多任务聚类联邦学习(clustered federated learning, CFL)的新方法,该方法的特点是基于社区检测(community detection)来进…☆66Updated 2 years ago
- ☆15Updated 3 years ago
- 一个用于联邦学习或分布式机器学习,对不同网络拓扑进行实验的简易框架。☆38Updated 2 years ago
- Research code that accompanies the paper FedCL: Federated Multi-Phase Curriculum Learning to Synchronously Correlate User Heterogeneity.☆21Updated last year
- vertical federated learning paper lists☆76Updated 4 years ago
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆34Updated last year
- THU-AIR Vertical Federated Learning general, extensible and light-weight framework☆92Updated 10 months ago
- Federated Fairness-aware Recommendation☆15Updated 2 years ago
- Everything about federated learning. Your contribution is highly valued!☆31Updated 3 years ago
- Federated Learning Framework Benchmark (UniFed)☆49Updated last year
- implementation of federated neural collaborative filtering algorithm☆11Updated last year
- 🔥数据科学竞赛 Baseline & Topline☆142Updated 2 years ago
- ☆111Updated 4 years ago
- Applied Split Learning in PyTorch with torch.distributed.rpc and torch.distributed.autograd☆26Updated 3 years ago
- Federated Learning on XGBoost☆46Updated 5 years ago
- ☆99Updated last year
- Ok-Topk is a scheme for distributed training with sparse gradients. Ok-Topk integrates a novel sparse allreduce algorithm (less than 6k c…☆26Updated 2 years ago
- 通过阅读Communication-Efficient Learning of Deep Networks from Decentralized Data与Robust and Communication-Efficient Federated Learning from …☆37Updated 2 years ago