NIH-HPC / spark-slurm
Tool for running/managing ad hoc spark clusters on a Slurm cluster
☆22Updated 2 years ago
Alternatives and similar repositories for spark-slurm:
Users that are interested in spark-slurm are comparing it to the libraries listed below
- ☆97Updated 3 months ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated 7 months ago
- Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)☆30Updated last month
- ☆12Updated 9 years ago
- server for storage and management of singularity images☆104Updated 6 months ago
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆196Updated last year
- Scripts and Ansible Playbooks for building an HPC-style resource in Jetstream☆19Updated 6 months ago
- SLURM Tools and UBiLities☆68Updated 2 years ago
- Collection of tutorials for using Shifter to bring containers to HPC☆26Updated 5 years ago
- dead Simple Queue - Slurm arrays for files with jobs in them.☆24Updated 2 years ago
- Howto and implementation documentation☆22Updated this week
- example singularity definition files and demos☆27Updated 6 years ago
- Add GPU support to your Singularity container!☆15Updated 7 years ago
- Container tools for scientific computing! Docs at https://singularityhub.github.io/singularityhub-docs☆68Updated 2 years ago
- DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm☆49Updated 3 months ago
- For installing and configuring SLURM - Simple Linux Utility for Resource Management☆35Updated 7 months ago
- Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.☆114Updated this week
- The configuration and scripts for using spark within a Sun Grid Engine environment☆24Updated 10 years ago
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- IPython magic for SLURM.☆67Updated 4 years ago
- NEWT - REST API for HPC☆11Updated 5 years ago
- Docker compose to bring up Open OnDemand with SLURM, Centos 7☆23Updated 2 years ago
- definition files and wrapper scripts used by NIH HPC staff to install user-facing apps on the Biowulf cluster☆29Updated 3 years ago
- Slurm on Google Cloud Platform☆183Updated 4 months ago
- An external library for delivering Slurm Elastic Computing.☆11Updated 7 years ago
- Location for the LSF DRMAA API originally creaded by FedStage☆20Updated last year
- cotainr - a user space Apptainer/Singularity container builder.☆21Updated last week
- A few utilities for use on a SLURM cluster☆41Updated 3 months ago
- orchestration for singularity containers (under development)☆72Updated 8 months ago
- ☆40Updated last week