ArchieGertsman / spark-sched-simLinks
A Gymnasium environment for simulating job scheduling in Apache Spark
☆41Updated last year
Alternatives and similar repositories for spark-sched-sim
Users that are interested in spark-sched-sim are comparing it to the libraries listed below
Sorting:
- Learning Scheduling Algorithms for Data Processing Clusters☆315Updated 4 years ago
- Deep reinforcement learning for REsource Allocation in streaM processing☆30Updated 2 years ago
- Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.☆95Updated 2 years ago
- ☆47Updated 4 years ago
- ☆25Updated last year
- CloudSimPy: Datacenter job scheduling simulation framework☆251Updated last year
- Random Directed Acyclic Graph Generator☆55Updated 3 years ago
- RLScheduler: An AutomatedHPC Batch Job Scheduler Using Reinforcement Learning [SC'20]☆63Updated 2 years ago
- ☆94Updated 2 years ago
- Implementation of the paper "A Reinforcement Learning Based Strategy for Dynamic Scheduling on Heterogeneous Platforms".☆89Updated 2 years ago
- DAGGEN: A synthethic task graph generator☆75Updated 3 years ago
- ☆19Updated last year
- [TPDS'21] COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments☆92Updated 2 years ago
- ☆22Updated last year
- ☆38Updated 4 years ago
- ☆20Updated last month
- A dataset of network topology, including the nodes/edges features and traffic matrices.☆18Updated 2 years ago
- An implementation of Deep Reinforcement Learning for Multi-Resource Multi-Machine Job Scheduling☆34Updated 5 years ago
- Virtual Network Function placement optimization with Deep Reinforcement Learning☆75Updated 2 years ago
- Dataset for IoT, Fog and Edge-based experiments☆54Updated 4 years ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆31Updated 4 years ago
- ☆243Updated 2 years ago
- PPIO workload prediction framework code☆22Updated last year
- Distributed deep learning cluster simulation environment and RL-GNN resource management implementations.☆14Updated 2 years ago
- ☆15Updated 2 years ago
- Deep reinforcement learning-based replacement strategy for content caching.☆64Updated 3 years ago
- [TMC'20] Deep Learning based Scheduler for Stochastic Fog-Cloud computing environments☆126Updated 2 years ago
- Codebase for Teal (SIGCOMM 2023)☆55Updated last year
- Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021☆27Updated 3 years ago
- HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling☆56Updated 6 years ago