ArchieGertsman / spark-sched-simLinks
A Gymnasium environment for simulating job scheduling in Apache Spark
☆42Updated 2 years ago
Alternatives and similar repositories for spark-sched-sim
Users that are interested in spark-sched-sim are comparing it to the libraries listed below
Sorting:
- Learning Scheduling Algorithms for Data Processing Clusters☆320Updated 4 years ago
- ☆26Updated 2 years ago
- CloudSimPy: Datacenter job scheduling simulation framework☆255Updated last year
- RLScheduler: An AutomatedHPC Batch Job Scheduler Using Reinforcement Learning [SC'20]☆64Updated 2 years ago
- (EuroSys'25) Towards VM Rescheduling Optimization Through Deep Reinforcement Learning☆23Updated 11 months ago
- Deep reinforcement learning for REsource Allocation in streaM processing☆31Updated 2 years ago
- Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.☆96Updated 2 years ago
- Dataset for IoT, Fog and Edge-based experiments☆55Updated 4 years ago
- ☆95Updated 2 years ago
- Implementation of the paper "A Reinforcement Learning Based Strategy for Dynamic Scheduling on Heterogeneous Platforms".☆92Updated 2 years ago
- ☆15Updated 3 years ago
- ☆47Updated 5 years ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆31Updated 5 years ago
- [TPDS'21] COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments☆95Updated 2 years ago
- ☆40Updated 4 years ago
- Random Directed Acyclic Graph Generator☆56Updated 3 years ago
- ☆17Updated 4 years ago
- DAGGEN: A synthethic task graph generator☆78Updated 3 years ago
- PPIO workload prediction framework code☆22Updated last year
- Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021☆28Updated 4 years ago
- A dataset of network topology, including the nodes/edges features and traffic matrices.☆20Updated 2 years ago
- HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling☆58Updated 6 years ago
- ☆23Updated last month
- Resource Management with DeepRL using TF Agents☆15Updated 5 years ago
- Codebase for Teal (SIGCOMM 2023)☆60Updated last year
- Deep Q Network model for two stage resource provisioning and task scheduling for Cloud computing☆95Updated 5 years ago
- ☆22Updated last year
- Deep reinforcement learning-based replacement strategy for content caching.☆66Updated 3 years ago
- Virtual Network Function placement optimization with Deep Reinforcement Learning☆77Updated 2 years ago
- [TMC'20] Deep Learning based Scheduler for Stochastic Fog-Cloud computing environments☆125Updated 3 years ago