Alternatives and similar repositories for spark-slurm:

Users that are interested in spark-slurm are comparing it to the libraries listed below

• NERSC / jupyterlab-slurm
  ☆97Updated 5 months ago
• jupyterhub / jupyterhub-deploy-hpc
  Documented examples of Jupyterhub deployment in HPC settings
  ☆36Updated 9 months ago
• cmd-ntrf / jupyter-lmod
  Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)
  ☆30Updated 3 months ago
• access-ci-org / Jetstream_Cluster
  Scripts and Ansible Playbooks for building an HPC-style resource in Jetstream
  ☆19Updated 9 months ago
• singularityhub / singularity-hpc
  Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.
  ☆118Updated 2 months ago
• natefoo / slurm-drmaa
  DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm
  ☆49Updated last month
• singularityhub / sregistry
  server for storage and management of singularity images
  ☆104Updated 8 months ago
• NIH-HPC / singularity-def-files
  definition files and wrapper scripts used by NIH HPC staff to install user-facing apps on the Biowulf cluster
  ☆30Updated 3 years ago
• LLNL / magpie
  Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…
  ☆198Updated last month
• mcapuccini / spark-on-slurm
  ☆12Updated 9 years ago
• jupyterhub / wrapspawner
  Mechanism for runtime configuration of spawners for JupyterHub
  ☆60Updated 11 months ago
• 4QuantOSS / sge_spark
  The configuration and scripts for using spark within a Sun Grid Engine environment
  ☆24Updated 10 years ago
• ga4gh / workflow-execution-service-schemas
  The WES API is a standard way to run and manage portable workflows.
  ☆83Updated 5 months ago
• NERSC / slurm-magic
  IPython magic for SLURM.
  ☆67Updated 5 years ago
• xalt / xalt
  XALT: System tracking of users codes on clusters
  ☆43Updated 3 weeks ago
• singularityhub / singularityhub.github.io
  Container tools for scientific computing! Docs at https://singularityhub.github.io/singularityhub-docs
  ☆69Updated 2 years ago
• alpha-unito / streamflow
  StreamFlow Workflow Manager
  ☆55Updated this week
• singularityhub / singularity-deploy
  Build and deploy Singularity containers to GitHub releases, and pull with the singularity-hpc client
  ☆16Updated last year
• afgane / slurmscale
  An external library for delivering Slurm Elastic Computing.
  ☆11Updated 7 years ago
• singularityhub / singularity-compose
  orchestration for singularity containers (under development)
  ☆74Updated 10 months ago
• hpcugent / hanythingondemand
  hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs
  ☆12Updated 5 years ago
• SchedMD / slurm-gcp
  Slurm on Google Cloud Platform
  ☆183Updated 6 months ago
• OSC / bc_osc_codeserver
  BETA - Batch Connect - OSC Code Server
  ☆18Updated 2 months ago
• NERSC / Shifter-Tutorial
  Collection of tutorials for using Shifter to bring containers to HPC
  ☆26Updated 6 years ago
• TACC / launcher
  A simple utility for executing multiple sequential or multi-threaded applications in a single multi-node batch job
  ☆62Updated last year
• ycrc / dSQ
  dead Simple Queue - Slurm arrays for files with jobs in them.
  ☆24Updated 2 years ago
• jupyterhub / batchspawner
  Custom Spawner for Jupyterhub to start servers in batch scheduled systems
  ☆193Updated 2 weeks ago
• NERSC / sshspawner
  Spawn JupyterHub single-user servers with ssh
  ☆24Updated 2 years ago
• zonca / singularity-comet
  Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center
  ☆18Updated 4 years ago
• NIH-HPC / singularity-examples
  example singularity definition files and demos
  ☆27Updated 6 years ago