ArchieGertsman / spark-sched-simLinks
A Gymnasium environment for simulating job scheduling in Apache Spark
☆41Updated last year
Alternatives and similar repositories for spark-sched-sim
Users that are interested in spark-sched-sim are comparing it to the libraries listed below
Sorting:
- Learning Scheduling Algorithms for Data Processing Clusters☆314Updated 4 years ago
- ☆25Updated last year
- CloudSimPy: Datacenter job scheduling simulation framework☆249Updated last year
- Deep reinforcement learning for REsource Allocation in streaM processing☆30Updated 2 years ago
- ☆94Updated 2 years ago
- RLScheduler: An AutomatedHPC Batch Job Scheduler Using Reinforcement Learning [SC'20]☆62Updated 2 years ago
- ☆47Updated 4 years ago
- Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.☆94Updated 2 years ago
- a deep learning-driven scheduler for elastic training in deep learning clusters☆32Updated 4 years ago
- ☆21Updated 3 weeks ago
- DAGGEN: A synthethic task graph generator☆75Updated 3 years ago
- ☆38Updated 4 years ago
- PPIO workload prediction framework code☆21Updated last year
- Codebase for Teal (SIGCOMM 2023)☆54Updated last year
- ☆19Updated last year
- Implementation of the paper "A Reinforcement Learning Based Strategy for Dynamic Scheduling on Heterogeneous Platforms".☆90Updated 2 years ago
- A dataset of network topology, including the nodes/edges features and traffic matrices.☆18Updated 2 years ago
- ☆240Updated 2 years ago
- [TPDS'21] COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments☆92Updated 2 years ago
- Random Directed Acyclic Graph Generator☆55Updated 3 years ago
- ☆17Updated last year
- HEFT, randomHEFT and IPEFT algorithms for static list DAG Scheduling☆56Updated 6 years ago
- A curated list of awesome edge AI computing / system research.☆31Updated 10 months ago
- Distributed deep learning cluster simulation environment and RL-GNN resource management implementations.☆14Updated 2 years ago
- ☆15Updated 2 years ago
- PPO implementation of the DRL agent used in the paper "Deep Reinforcement Learning meets Graph Neural Networks: exploring a routing optim…☆138Updated 3 years ago
- ☆32Updated 2 years ago
- ☆21Updated last year
- Virtual Network Function placement optimization with Deep Reinforcement Learning☆73Updated 2 years ago
- Code for "Solving Large-Scale Granular Resource Allocation Problems Efficiently with POP", which appeared at SOSP 2021☆28Updated 3 years ago