ArchieGertsman / spark-sched-sim
A Gymnasium environment for simulating job scheduling in Apache Spark
☆33Updated last year
Alternatives and similar repositories for spark-sched-sim:
Users that are interested in spark-sched-sim are comparing it to the libraries listed below
- ☆23Updated last year
- Deep reinforcement learning for REsource Allocation in streaM processing☆29Updated last year
- ☆46Updated 4 years ago
- Learning Scheduling Algorithms for Data Processing Clusters☆299Updated 3 years ago
- ☆90Updated 2 years ago
- ☆38Updated 3 years ago
- ☆20Updated last year
- [TPDS'21] COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments☆85Updated last year
- Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021☆25Updated 3 years ago
- Random Directed Acyclic Graph Generator☆53Updated 2 years ago
- DAGGEN: A synthethic task graph generator☆65Updated 2 years ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆29Updated 4 years ago
- Dataset for IoT, Fog and Edge-based experiments☆50Updated 4 years ago
- Implementation of the paper "A Reinforcement Learning Based Strategy for Dynamic Scheduling on Heterogeneous Platforms".☆83Updated 2 years ago
- PPIO workload prediction framework code☆19Updated 9 months ago
- Implement job scheduling based on REINFORCE and Graph Embedding.☆19Updated 4 years ago
- INFOCOM 2024: Online Resource Allocation for Edge Intelligence with Colocated Model Retraining and Inference☆14Updated 6 months ago
- ☆17Updated last year
- HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling☆51Updated 5 years ago
- Virtual Network Function placement optimization with Deep Reinforcement Learning☆71Updated 2 years ago
- Deep Q Network model for two stage resource provisioning and task scheduling for Cloud computing☆86Updated 4 years ago
- multi-workflow scheduling☆10Updated 3 years ago
- The source code and experimental results of RSDQL.☆26Updated 3 years ago
- [TMC'20] Deep Learning based Scheduler for Stochastic Fog-Cloud computing environments☆117Updated 2 years ago
- ☆14Updated 2 years ago
- A curated list of awesome edge AI computing / system research.☆23Updated 4 months ago
- RLScheduler: An AutomatedHPC Batch Job Scheduler Using Reinforcement Learning [SC'20]☆58Updated last year
- Implementation of genetic algorithm and MOHEFT algorithm for scheduling workflow in mobile cloud.☆18Updated 8 years ago
- PPO implementation of the DRL agent used in the paper "Deep Reinforcement Learning meets Graph Neural Networks: exploring a routing optim…☆108Updated 2 years ago
- Codebase for Teal (SIGCOMM 2023)☆51Updated last year