NIH-HPC / spark-slurm
Tool for running/managing ad hoc spark clusters on a Slurm cluster
☆25Updated 2 years ago
Alternatives and similar repositories for spark-slurm
Users that are interested in spark-slurm are comparing it to the libraries listed below
Sorting:
- ☆98Updated 7 months ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated 11 months ago
- ☆12Updated 9 years ago
- Scripts and Ansible Playbooks for building an HPC-style resource in Jetstream☆19Updated 10 months ago
- Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)☆31Updated 4 months ago
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆197Updated 3 months ago
- The configuration and scripts for using spark within a Sun Grid Engine environment☆24Updated 10 years ago
- example singularity definition files and demos☆27Updated 6 years ago
- Script for doing Slurm Calculations☆11Updated last month
- definition files and wrapper scripts used by NIH HPC staff to install user-facing apps on the Biowulf cluster☆30Updated 4 years ago
- Spawn JupyterHub single-user servers with ssh☆25Updated 2 years ago
- Custom Spawner for Jupyterhub to start servers in batch scheduled systems☆195Updated last month
- IPython magic for SLURM.☆69Updated 5 years ago
- Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.☆118Updated last month
- DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm☆49Updated last month
- Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center☆18Updated 4 years ago
- dead Simple Queue - Slurm arrays for files with jobs in them.☆24Updated 3 years ago
- Direct Acyclic Graph (DAG) Workflow Submitter for SLURM queueing system☆16Updated last year
- BETA - Batch Connect - OSC Code Server☆18Updated last month
- Scripts for viewing Slurm batch job resource usages☆11Updated 3 years ago
- A demo and tutorial for how to use git and singularity to make your research more portable and reproducible☆26Updated 8 years ago
- server for storage and management of singularity images☆104Updated 10 months ago
- An example GitHub Action (CI) to build a Singularity container☆69Updated last year
- Sandstone IDE☆12Updated 7 years ago
- XALT: System tracking of users codes on clusters☆44Updated last month
- SLURM Tools and UBiLities☆69Updated 2 years ago
- Mechanism for runtime configuration of spawners for JupyterHub☆61Updated last year
- spart: a user-oriented partition info command for slurm☆23Updated last year
- ECP-CANDLE Benchmarks☆59Updated 8 months ago
- A repository of definition files for bootstrapping Singularity containers around the software applications, frameworks, and libraries you…☆64Updated last week