glennklockwood / myhadoop
Framework for deploying Hadoop clusters on traditional HPC from userland
☆46Updated 7 years ago
Alternatives and similar repositories for myhadoop:
Users that are interested in myhadoop are comparing it to the libraries listed below
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆198Updated 3 weeks ago
- Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center☆18Updated 4 years ago
- Introduction to Hadoop for those from an HPC simulation background☆31Updated 10 years ago
- Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)☆30Updated 2 months ago
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- gather and plot data about Slurm scheduling and job statistics☆51Updated 10 years ago
- XALT: System tracking of users codes on clusters☆43Updated last week
- Custom Spawner for Jupyterhub to start slurm jobs when users log in☆24Updated 2 years ago
- The old ADIOS 1.x code repository. Look for ADIOS2 for new repo☆54Updated 10 months ago
- hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs☆12Updated 5 years ago
- ☆28Updated 5 years ago
- ☆58Updated 2 years ago
- Slides and materials for workshop at University of Michigan MICDE☆19Updated 8 years ago
- Scalable dynamic library and python loading in HPC environments☆100Updated 2 months ago
- Remote Spawner class for JupyterHub to spawn IPython notebooks and a remote server and tunnel the port via SSH☆26Updated 8 years ago
- Collection of tutorials for using Shifter to bring containers to HPC☆26Updated 6 years ago
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated 8 months ago
- Default Repo description from terraform module☆5Updated 5 years ago
- The configuration and scripts for using spark within a Sun Grid Engine environment☆24Updated 10 years ago
- Tool for running/managing ad hoc spark clusters on a Slurm cluster☆22Updated 2 years ago
- Collection of easyblocks that implement support for building and installing software with EasyBuild.☆108Updated this week
- HPCPerfStats is an automated resource-usage monitoring and analysis package.☆46Updated this week
- Several utilities to aid in the use, administration, and management of PBS variants (including OpenPBS, PBS Pro, and TORQUE).☆25Updated 2 years ago
- Share Spack configuration files with other HPC sites☆66Updated 2 months ago
- Deploy Dask on DRMAA clusters☆40Updated 4 years ago
- Pavilion is a Python 3 (3.5+) based framework for running and analyzing tests targeting HPC systems.☆44Updated this week
- ☆97Updated 5 months ago
- NEWT - REST API for HPC☆11Updated 5 years ago
- High-level python wapper for the Sun Grid Engine (SGE) using DRMAA and ZMQ☆21Updated 11 years ago
- SCR caches checkpoint data in storage on the compute nodes of a Linux cluster to provide a fast, scalable checkpoint / restart capability…☆102Updated 3 months ago