NIH-HPC / spark-slurmLinks
Tool for running/managing ad hoc spark clusters on a Slurm cluster
☆25Updated 3 years ago
Alternatives and similar repositories for spark-slurm
Users that are interested in spark-slurm are comparing it to the libraries listed below
Sorting:
- ☆102Updated last year
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆196Updated 11 months ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated last year
- Slurm on Google Cloud Platform☆189Updated last year
- Container tools for scientific computing! Docs at https://singularityhub.github.io/singularityhub-docs☆69Updated 3 years ago
- Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.☆127Updated last month
- Custom Spawner for Jupyterhub to start servers in batch scheduled systems☆201Updated 2 weeks ago
- orchestration for singularity containers (under development)☆76Updated last year
- The configuration and scripts for using spark within a Sun Grid Engine environment☆24Updated 11 years ago
- IPython magic for SLURM.☆69Updated 5 years ago
- Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)☆33Updated 5 months ago
- SLURM Tools and UBiLities☆74Updated 3 years ago
- DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm☆48Updated last month
- A demo and tutorial for how to use git and singularity to make your research more portable and reproducible☆26Updated 9 years ago
- Slides and materials for workshop at University of Michigan MICDE☆19Updated 9 years ago
- Jupyter extensions for running a Xpra Session proxy☆15Updated 10 months ago
- Batch Connect - OSC Code Server☆18Updated 5 months ago
- Build and deploy Singularity containers to GitHub releases, and pull with the singularity-hpc client☆17Updated 2 years ago
- server for storage and management of singularity images☆105Updated last year
- Collection of tutorials for using Shifter to bring containers to HPC☆27Updated 6 years ago
- ☆94Updated 6 years ago
- Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center☆18Updated 5 years ago
- a full day lesson material to teach the basics of using a HPC cluster to novices☆36Updated 6 years ago
- StreamFlow Workflow Manager☆61Updated this week
- Mechanism for runtime configuration of spawners for JupyterHub☆65Updated last year
- ☆18Updated 7 months ago
- An example GitHub Action (CI) to build a Singularity container☆71Updated 2 years ago
- Python wrapper around the C DRMAA library.☆108Updated 6 years ago
- HPC Python lesson materials☆61Updated 2 years ago
- A command line interface to Globus☆87Updated this week