Alternatives and similar repositories for spark-slurm

Users that are interested in spark-slurm are comparing it to the libraries listed below

• NERSC / jupyterlab-slurm
  ☆99Updated 9 months ago
• LLNL / magpie
  Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…
  ☆197Updated 5 months ago
• SchedMD / slurm-gcp
  Slurm on Google Cloud Platform
  ☆189Updated 9 months ago
• jupyterhub / jupyterhub-deploy-hpc
  Documented examples of Jupyterhub deployment in HPC settings
  ☆36Updated last year
• singularityhub / singularityhub.github.io
  Container tools for scientific computing! Docs at https://singularityhub.github.io/singularityhub-docs
  ☆69Updated 3 years ago
• singularityhub / singularity-deploy
  Build and deploy Singularity containers to GitHub releases, and pull with the singularity-hpc client
  ☆17Updated last year
• 4QuantOSS / sge_spark
  The configuration and scripts for using spark within a Sun Grid Engine environment
  ☆24Updated 11 years ago
• mcapuccini / spark-on-slurm
  ☆12Updated 9 years ago
• sylabs / examples
  files and instructions for creating and using example containers from the sylabs.io blog
  ☆105Updated 2 years ago
• singularityhub / singularity-compose
  orchestration for singularity containers (under development)
  ☆76Updated last year
• singularityhub / sregistry
  server for storage and management of singularity images
  ☆104Updated last year
• abdulrahmanazab / sdag
  Direct Acyclic Graph (DAG) Workflow Submitter for SLURM queueing system
  ☆16Updated last year
• ycrc / dSQ
  dead Simple Queue - Slurm arrays for files with jobs in them.
  ☆24Updated 3 years ago
• cmd-ntrf / jupyter-lmod
  Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)
  ☆32Updated 2 weeks ago
• NIH-HPC / singularity-def-files
  definition files and wrapper scripts used by NIH HPC staff to install user-facing apps on the Biowulf cluster
  ☆30Updated 4 years ago
• NIH-HPC / singularity-examples
  example singularity definition files and demos
  ☆27Updated 7 years ago
• OSC / Open-OnDemand
  Supercomputing. Seamlessly. Open, Interactive HPC Via the Web
  ☆93Updated 3 years ago
• singularityhub / singularity-hpc
  Local filesystem registry for containers (intended for HPC) using Lmod or Environment Modules. Works for users and admins.
  ☆121Updated last month
• jupyterhub / batchspawner
  Custom Spawner for Jupyterhub to start servers in batch scheduled systems
  ☆197Updated last week
• statgen / SLURM-examples
  ☆92Updated 6 years ago
• natefoo / slurm-drmaa
  DRMAA for Slurm: Implementation of the DRMAA C bindings for Slurm
  ☆49Updated 3 months ago
• xalt / xalt
  XALT: System tracking of users codes on clusters
  ☆45Updated 2 weeks ago
• cjprybol / reproducibility-via-singularity
  A demo and tutorial for how to use git and singularity to make your research more portable and reproducible
  ☆26Updated 8 years ago
• alpha-unito / streamflow
  StreamFlow Workflow Manager
  ☆58Updated this week
• pygridtools / gridmap
  Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).
  ☆84Updated 2 years ago
• accre / SLURM
  SLURM Example Scripts
  ☆70Updated 5 years ago
• elasticluster / elasticluster
  Create clusters of VMs on the cloud and configure them with Ansible.
  ☆337Updated last year
• pygridtools / drmaa-python
  Python wrapper around the C DRMAA library.
  ☆108Updated 6 years ago
• ubccr / stubl
  SLURM Tools and UBiLities
  ☆72Updated 2 years ago
• OSC / bc_osc_codeserver
  Batch Connect - OSC Code Server
  ☆18Updated last month