ArchieGertsman / spark-sched-sim
A Gymnasium environment for simulating job scheduling in Apache Spark
☆27Updated last year
Alternatives and similar repositories for spark-sched-sim:
Users that are interested in spark-sched-sim are comparing it to the libraries listed below
- ☆19Updated last year
- ☆44Updated 4 years ago
- ☆17Updated last year
- ☆19Updated 10 months ago
- Deep reinforcement learning for REsource Allocation in streaM processing☆28Updated last year
- PPIO workload prediction framework code☆17Updated 6 months ago
- Learning Scheduling Algorithms for Data Processing Clusters☆294Updated 3 years ago
- Distributed deep learning cluster simulation environment and RL-GNN resource management implementations.☆12Updated last year
- Implementation of the paper "A Reinforcement Learning Based Strategy for Dynamic Scheduling on Heterogeneous Platforms".☆79Updated last year
- ☆38Updated 3 years ago
- PBScaler: A Bottleneck-aware Autoscaling Framework for Microservice-based Applications☆23Updated last month
- 基于强化学习的云计算虚拟机放置☆17Updated 5 years ago
- A CLI tool generating traces of batch jobs in a cluster.☆24Updated last year
- Deep Q Network model for two stage resource provisioning and task scheduling for Cloud computing☆77Updated 4 years ago
- Kubernetes Scheduler Simulator☆91Updated 6 months ago
- Virtual Network Function placement optimization with Deep Reinforcement Learning☆70Updated last year
- Implement job scheduling based on REINFORCE and Graph Embedding.☆18Updated 4 years ago
- [TPDS'21] COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments☆82Updated last year
- A real-time workflow scheduling system in a cloud computing environment with a deep reinforcement learning approach☆24Updated 2 years ago
- [TMC'20] Deep Learning based Scheduler for Stochastic Fog-Cloud computing environments☆110Updated 2 years ago
- The source code and experimental results of RSDQL.☆23Updated 2 years ago
- Codebase for Teal (SIGCOMM 2023)☆46Updated 9 months ago
- Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021☆24Updated 3 years ago
- Implementation of genetic algorithm and MOHEFT algorithm for scheduling workflow in mobile cloud.☆17Updated 7 years ago
- Random Directed Acyclic Graph Generator☆51Updated 2 years ago
- Dataset for IoT, Fog and Edge-based experiments☆49Updated 3 years ago
- ☆14Updated 2 years ago
- MEC,Edge service, Edge Application, Service Computing.☆59Updated 2 years ago
- An implementation of Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling☆33Updated 4 years ago
- DAGGEN: A synthethic task graph generator☆64Updated 2 years ago