LLNL / magpie
Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for Lustre, Slurm, Moab, Torque. LSF, Flux, and more.
☆191Updated 9 months ago
Related projects: ⓘ
- Framework for deploying Hadoop clusters on traditional HPC from userland☆46Updated 6 years ago
- core services for the Flux resource management framework☆167Updated this week
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- Shifter - Linux Containers for HPC☆348Updated 5 months ago
- Tool for running/managing ad hoc spark clusters on a Slurm cluster☆21Updated 2 years ago
- gather and plot data about Slurm scheduling and job statistics☆50Updated 9 years ago
- Create clusters of VMs on the cloud and configure them with Ansible.☆335Updated last year
- hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs☆12Updated 5 years ago
- Collection of tutorials for using Shifter to bring containers to HPC☆26Updated 5 years ago
- Lightweight user-defined software stacks for high-performance computing.☆312Updated this week
- REMORA: REsource MOnitoring for Remote Applications☆58Updated 2 months ago
- StarCluster is an open source cluster-computing toolkit for Amazon's Elastic Compute Cloud (EC2).☆582Updated 2 years ago
- ☆28Updated 5 years ago
- An open framework for collecting and analyzing HPC metrics.☆84Updated last week
- ☆92Updated last week
- MPI Testing Tool☆61Updated 7 months ago
- SLURM jobcomp plugin to index data into an elasticsearch server☆13Updated 7 years ago
- SLURM: A Highly Scalable Resource Manager☆64Updated 7 years ago
- TACC Stats is an automated resource-usage monitoring and analysis package.☆41Updated this week
- Several utilities to aid in the use, administration, and management of PBS variants (including OpenPBS, PBS Pro, and TORQUE).☆25Updated last year
- Tutorial for installing Open XDMoD, OnDemand, & ColdFront☆115Updated last month
- Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark☆42Updated 3 years ago
- XALT: System tracking of users codes on clusters☆42Updated 2 months ago
- IPython magic for SLURM.☆67Updated 4 years ago
- Robinhood Policy Engine : a versatile tool to monitor filesystem contents and schedule actions on filesystem entries.☆177Updated 3 weeks ago
- Slurm on Google Cloud Platform☆178Updated this week
- SLURM Tools and UBiLities☆68Updated 2 years ago
- File utilities designed for scalability and performance.☆164Updated 3 weeks ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated 3 months ago
- Fluxion Graph-based Scheduler☆86Updated this week