Alternatives and similar repositories for spark-slurm

Users that are interested in spark-slurm are comparing it to the libraries listed below

• NERSC / jupyterlab-slurm
  ☆98Updated 8 months ago
• mcapuccini / spark-on-slurm
  ☆12Updated 9 years ago
• jupyterhub / jupyterhub-deploy-hpc
  Documented examples of Jupyterhub deployment in HPC settings
  ☆36Updated 11 months ago
• cmd-ntrf / jupyter-lmod
  Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)
  ☆31Updated 2 weeks ago
• natefoo / slurm-drmaa
  DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm
  ☆49Updated 2 months ago
• access-ci-org / Jetstream_Cluster
  Scripts and Ansible Playbooks for building an HPC-style resource in Jetstream
  ☆19Updated 11 months ago
• LLNL / magpie
  Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…
  ☆197Updated 3 months ago
• clemsonciti / singularity-in-jupyter-notebook
  Using singularity containers from Jupyter Notebook
  ☆9Updated 8 years ago
• NERSC / slurm-magic
  IPython magic for SLURM.
  ☆69Updated 5 years ago
• singularityhub / singularity-deploy
  Build and deploy Singularity containers to GitHub releases, and pull with the singularity-hpc client
  ☆17Updated last year
• 4QuantOSS / sge_spark
  The configuration and scripts for using spark within a Sun Grid Engine environment
  ☆24Updated 10 years ago
• cjprybol / reproducibility-via-singularity
  A demo and tutorial for how to use git and singularity to make your research more portable and reproducible
  ☆26Updated 8 years ago
• singularityhub / singularityhub.github.io
  Container tools for scientific computing! Docs at https://singularityhub.github.io/singularityhub-docs
  ☆69Updated 2 years ago
• singularityhub / sregistry
  server for storage and management of singularity images
  ☆104Updated 11 months ago
• OSC / bc_osc_codeserver
  BETA - Batch Connect - OSC Code Server
  ☆18Updated last month
• ycrc / dSQ
  dead Simple Queue - Slurm arrays for files with jobs in them.
  ☆24Updated 3 years ago
• NERSC / Shifter-Tutorial
  Collection of tutorials for using Shifter to bring containers to HPC
  ☆26Updated 6 years ago
• FredHutch / easybuild-life-sciences
  Howto and implementation documentation
  ☆22Updated this week
• pygridtools / drmaa-python
  Python wrapper around the C DRMAA library.
  ☆108Updated 6 years ago
• alpha-unito / streamflow
  StreamFlow Workflow Manager
  ☆56Updated this week
• SchedMD / slurm-gcp
  Slurm on Google Cloud Platform
  ☆187Updated 8 months ago
• zonca / singularity-comet
  Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center
  ☆18Updated 4 years ago
• sylabs / wlm-operator
  Singularity implementation of k8s operator for interacting with SLURM.
  ☆117Updated 4 years ago
• singularityhub / singularity-cli
  streamlined singularity python client (spython) for singularity
  ☆59Updated 8 months ago
• singularityhub / singularity-hpc
  Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.
  ☆120Updated this week
• abdulrahmanazab / sdag
  Direct Acyclic Graph (DAG) Workflow Submitter for SLURM queueing system
  ☆16Updated last year
• hpcugent / hanythingondemand
  hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs
  ☆12Updated 5 years ago
• FredHutch / slurm-examples
  examples of using slurm in life sciences workflows using posix file systems and object storage
  ☆41Updated last year
• singularityhub / github-ci
  An example GitHub Action (CI) to build a Singularity container
  ☆70Updated last year
• NIH-HPC / singularity-examples
  example singularity definition files and demos
  ☆27Updated 6 years ago