orion-orion / Distributed-ML-PySparkLinks
🔨 使用Spark/Pytorch实现分布式算法,包括图/矩阵计算(graph/matrix computation)、随机算法、优化(optimization)和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程
☆39Updated 2 years ago
Alternatives and similar repositories for Distributed-ML-PySpark
Users that are interested in Distributed-ML-PySpark are comparing it to the libraries listed below
Sorting:
- 中科大凌青老师凸优化课程的课程笔记☆35Updated 4 years ago
- A high-performance distributed deep learning system targeting large-scale and automated distributed training.☆323Updated 2 months ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆35Updated last year
- Graph Partitioning for Large-scale Graph Datasets☆97Updated 3 years ago
- ☆100Updated last year
- Papers related to federated learning for recommender system☆32Updated 4 years ago
- The code for the paper "QuAFL: Federated Averaging Can Be Both Asynchronous and Communication-Efficient"☆17Updated 2 years ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆32Updated 4 years ago
- 🔬 [SDM'24] This is the source code and baselines of our paper FedDCSR: Federated Cross-domain Sequential Recommendation via Disentangled…☆31Updated last year
- Source code for Learn Locally Correct Globally☆14Updated 3 years ago
- A tree-based federated learning system (MLSys 2023)☆149Updated 8 months ago
- A PyTorch-like deep learning framework. Just for fun.☆155Updated 2 years ago
- 顶不住的运筹优化☆184Updated last year
- Learning material for CMU10-714: Deep Learning System☆279Updated last year
- FedGraph (Federated Graph) is a library built upon PyTorch to easily train Graph Neural Networks under federated setting.☆57Updated this week
- 联邦学习系统,包括常用算法和通用训练推理系统框架 | Fedlearn Main System, Including Algorithms and Frameworks for Training / Inference.☆76Updated 3 years ago
- An implementation of parameter server framework in PyTorch RPC.☆12Updated 3 years ago
- ☆23Updated 3 years ago
- Federated Learning for LLMs.☆233Updated 10 months ago
- Federated Fairness-aware Recommendation☆14Updated 3 years ago
- Surrogate-based Hyperparameter Tuning System☆27Updated 2 years ago
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆34Updated 2 years ago
- Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing☆60Updated 9 months ago
- Towards Generalized and Efficient Blackbox Optimization System/Package (KDD 2021 & JMLR 2024)☆425Updated 3 weeks ago
- InFi is a library for building input filters for resource-efficient inference.☆39Updated last year
- My future research☆414Updated 2 years ago
- ☆15Updated 4 years ago
- 一个用于学习的仿Pytorch纯Python实现的自动求导工具。☆51Updated last year
- 🔥数据科学竞赛 Baseline & Topline☆141Updated 2 years ago
- HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling☆56Updated 6 years ago