ArchieGertsman / spark-sched-simLinks
A Gymnasium environment for simulating job scheduling in Apache Spark
☆37Updated last year
Alternatives and similar repositories for spark-sched-sim
Users that are interested in spark-sched-sim are comparing it to the libraries listed below
Sorting:
- Learning Scheduling Algorithms for Data Processing Clusters☆308Updated 4 years ago
- CloudSimPy: Datacenter job scheduling simulation framework☆243Updated last year
- PPIO workload prediction framework code☆19Updated 11 months ago
- ☆46Updated 4 years ago
- Deep reinforcement learning for REsource Allocation in streaM processing☆30Updated 2 years ago
- ☆24Updated last year
- ☆38Updated 3 years ago
- Dataset for IoT, Fog and Edge-based experiments☆50Updated 4 years ago
- [TPDS'21] COSCO: Container Orchestration using Co-Simulation and Gradient Based Optimization for Fog Computing Environments☆91Updated last year
- RLScheduler: An AutomatedHPC Batch Job Scheduler Using Reinforcement Learning [SC'20]☆61Updated 2 years ago
- ☆15Updated 2 years ago
- Codebase for Teal (SIGCOMM 2023)☆52Updated last year
- ☆21Updated last year
- ☆92Updated 2 years ago
- ☆17Updated last year
- Implementation of the paper "A Reinforcement Learning Based Strategy for Dynamic Scheduling on Heterogeneous Platforms".☆86Updated 2 years ago
- Distributed deep learning cluster simulation environment and RL-GNN resource management implementations.☆14Updated 2 years ago
- DAGGEN: A synthethic task graph generator☆69Updated 3 years ago
- Random Directed Acyclic Graph Generator☆54Updated 2 years ago
- Our VMAgent is a platform for exploiting Reinforcement Learning (RL) on Virtual Machine (VM) scheduling tasks.☆93Updated 2 years ago
- Edge server, user dataset for Edge Computing research☆387Updated last year
- Implementation of genetic algorithm and MOHEFT algorithm for scheduling workflow in mobile cloud.☆18Updated 8 years ago
- ☆19Updated 8 months ago
- A dataset of network topology, including the nodes/edges features and traffic matrices.☆18Updated last year
- ☆238Updated 2 years ago
- Deep Q Network model for two stage resource provisioning and task scheduling for Cloud computing☆88Updated 4 years ago
- Resource Management with DeepRL using TF Agents☆14Updated 4 years ago
- Codebase for Autothrottle (NSDI 2024)☆48Updated last year
- PBScaler: A Bottleneck-aware Autoscaling Framework for Microservice-based Applications☆26Updated 7 months ago
- Official Implementation of our KDD 2023 Paper: PERT-GNN: Latency Prediction for Microservice-based Cloud-Native Applications via Graph Ne…☆13Updated last year