NIH-HPC / spark-slurm
Tool for running/managing ad hoc spark clusters on a Slurm cluster
☆22Updated 2 years ago
Alternatives and similar repositories for spark-slurm:
Users that are interested in spark-slurm are comparing it to the libraries listed below
- ☆97Updated 4 months ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated 8 months ago
- Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)☆30Updated last month
- ☆12Updated 9 years ago
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆197Updated this week
- example singularity definition files and demos☆27Updated 6 years ago
- Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.☆117Updated last month
- StreamFlow Workflow Manager☆55Updated this week
- dead Simple Queue - Slurm arrays for files with jobs in them.☆24Updated 2 years ago
- Scripts and Ansible Playbooks for building an HPC-style resource in Jetstream☆19Updated 7 months ago
- server for storage and management of singularity images☆104Updated 7 months ago
- Howto and implementation documentation☆22Updated this week
- Direct Acyclic Graph (DAG) Workflow Submitter for SLURM queueing system☆15Updated last year
- A few utilities for use on a SLURM cluster☆41Updated 4 months ago
- definition files and wrapper scripts used by NIH HPC staff to install user-facing apps on the Biowulf cluster☆30Updated 3 years ago
- An external library for delivering Slurm Elastic Computing.☆11Updated 7 years ago
- spart: a user-oriented partition info command for slurm☆21Updated last year
- XALT: System tracking of users codes on clusters☆43Updated 2 months ago
- SLURM Tools and UBiLities☆68Updated 2 years ago
- Add GPU support to your Singularity container!☆15Updated 7 years ago
- DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm☆49Updated 4 months ago
- orchestration for singularity containers (under development)☆73Updated 9 months ago
- A demo and tutorial for how to use git and singularity to make your research more portable and reproducible☆26Updated 8 years ago
- Scripts for viewing Slurm batch job resource usages☆11Updated 3 years ago
- Container tools for scientific computing! Docs at https://singularityhub.github.io/singularityhub-docs☆68Updated 2 years ago
- Custom Spawner for Jupyterhub to start servers in batch scheduled systems☆192Updated last week
- A modification to the slurm_showq code written by TACC.☆43Updated 2 months ago
- Open OnDemand apps for Sherlock☆19Updated 2 months ago
- IPython magic for SLURM.☆67Updated 4 years ago
- examples of using slurm in life sciences workflows using posix file systems and object storage☆39Updated 8 months ago