orion-orion / Distributed-ML-PySparkLinks
🔨 使用Spark/Pytorch实现分布式算法，包括图/矩阵计算（graph/matrix computation）、随机算法、优化（optimization）和机器学习。参考刘铁岩《分布式机器学习》和CME 323课程
☆40Updated 2 years ago
Alternatives and similar repositories for Distributed-ML-PySpark
Users that are interested in Distributed-ML-PySpark are comparing it to the libraries listed below
Sorting:
- 中科大凌青老师凸优化课程的课程笔记☆38Updated 5 years ago
- 顶不住的运筹优化☆193Updated last year
- Graph Partitioning for Large-scale Graph Datasets☆97Updated 4 years ago
- ☆102Updated 2 years ago
- PipeEdge: Pipeline Parallelism for Large-Scale Model Inference on Heterogeneous Edge Devices☆37Updated 2 years ago
- 论文实验数据绘图（CS类）☆44Updated 11 months ago
- The code for the paper "QuAFL: Federated Averaging Can Be Both Asynchronous and Communication-Efficient"☆17Updated 2 years ago
- A high-performance distributed deep learning system targeting large-scale and automated distributed training.☆333Updated last month
- 2020-2021学年的国科大雁栖湖集中教学选修课程课件☆21Updated 4 years ago
- 算法岗面试资料-百面深度学习、百面机器学习书籍等等☆75Updated 2 years ago
- ☆13Updated last year
- Course materials for MIT6.5940: TinyML and Efficient Deep Learning Computing☆68Updated last year
- Source code for Learn Locally Correct Globally☆14Updated 4 years ago
- a curated list of high-quality papers on resource-efficient LLMs 🌱☆156Updated 10 months ago
- 分享AI Infra知识&代码练习：PyTorch/vLLM/SGLang框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等☆215Updated this week
- A curated list of research in System for Edge Intelligence and Computing(Edge MLSys), including Frameworks, Tools, Repository, etc. Paper…☆32Updated 4 years ago
- Towards Generalized and Efficient Blackbox Optimization System/Package (KDD 2021 & JMLR 2024)☆432Updated 2 weeks ago
- Learning material for CMU10-714: Deep Learning System☆300Updated last year
- Efficient Hyper-parameter Tuning at Scale (VLDB'22)☆10Updated 4 years ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆31Updated 5 years ago
- Source codes of "Fast Continuous Subgraph Matching over Streaming Graphs via Backtracking Reduction", SIGMOD 2023☆14Updated 2 years ago
- "Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.☆34Updated 2 years ago
- RLScheduler: An AutomatedHPC Batch Job Scheduler Using Reinforcement Learning [SC'20]☆64Updated 2 years ago
- A demo of end-to-end federated learning system.☆69Updated 3 years ago
- 运筹优化入门培训资料, 以启发式算法为主.☆104Updated 2 years ago
- USTC 2021春季学期 深度学习导论实验：FNN，CNN，RNN，LSTM，BERT，GCN☆30Updated 4 years ago
- A PyTorch-like deep learning framework. Just for fun.☆157Updated 2 years ago
- 联邦学习系统，包括常用算法和通用训练推理系统框架 | Fedlearn Main System, Including Algorithms and Frameworks for Training / Inference.☆77Updated 4 years ago
- 发布研究论文代码的小技巧☆87Updated 5 years ago
- 🔬 [SDM'24] This is the source code and baselines of our paper FedDCSR: Federated Cross-domain Sequential Recommendation via Disentangled…☆31Updated last year