orion-orion / Distributed-ML-PySparkLinks
🔨 使用Spark/Pytorch实现分布式算法,包括图/矩阵计算(graph/matrix computation)、随机算法、优化(optimization)和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程
☆40Updated 2 years ago
Alternatives and similar repositories for Distributed-ML-PySpark
Users that are interested in Distributed-ML-PySpark are comparing it to the libraries listed below
Sorting:
- 中科大凌青老师凸优化课程的课程笔记☆37Updated 4 years ago
- The code for the paper "QuAFL: Federated Averaging Can Be Both Asynchronous and Communication-Efficient"☆17Updated 2 years ago
- InFi is a library for building input filters for resource-efficient inference.☆40Updated 2 years ago
- ☆101Updated last year
- 算法岗面试资料-百面深度学习、百面机器学习书籍等等☆69Updated 2 years ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆36Updated last year
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆34Updated 2 years ago
- A demo of end-to-end federated learning system.☆69Updated 3 years ago
- Overview of Federal Learning☆293Updated 2 years ago
- 顶不住的运筹优化☆189Updated last year
- 🔥数据科学竞赛 Baseline & Topline☆141Updated 2 years ago
- A curated list of research in System for Edge Intelligence and Computing(Edge MLSys), including Frameworks, Tools, Repository, etc. Paper…☆30Updated 3 years ago
- 此项目中将上传我在B站《强化学习理论基础》系列视频中的板书、参考资料等内容。☆81Updated 2 years ago
- ☆29Updated last week
- 🔬 FedCom为SWPU2022届本科毕业设计《基于社区检测的多任务聚类联邦学习》。本研究提出了一种多任务聚类联邦学习(clustered federated learning, CFL)的新方法,该方法的特点是基于社区检测(community detection)来进…☆66Updated 2 years ago
- 水很深的深度学习☆132Updated last year
- Learning material for CMU10-714: Deep Learning System☆283Updated last year
- A tree-based federated learning system (MLSys 2023)☆151Updated 10 months ago
- 🔬 [SDM'24] This is the source code and baselines of our paper FedDCSR: Federated Cross-domain Sequential Recommendation via Disentangled…☆31Updated last year
- ☆20Updated 11 months ago
- 高性能计算相关知识学习笔记,包含学习笔记和相关知识的代码demo,在持续完善中。 如果有帮助的话请Star一下,对作者帮助很大,谢谢!☆457Updated 2 years ago
- Federated Learning for LLMs.☆236Updated 2 weeks ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆31Updated 4 years ago
- ☆20Updated 3 years ago
- llm theoretical performance analysis tools and support params, flops, memory and latency analysis.☆112Updated 4 months ago
- ☆210Updated last year
- An implementation of federated learning research baseline methods based on FedML-core, which can be deployed on real distributed cluster …☆29Updated 3 years ago
- A high-performance distributed deep learning system targeting large-scale and automated distributed training.☆327Updated 3 months ago
- 🎓Automatically Update Distributed Learning Papers Daily using Github Actions (Update Every 12th hours)☆43Updated this week
- Plato: A Research Framework for Federated Learning☆385Updated last week