glennklockwood / myhadoop
Framework for deploying Hadoop clusters on traditional HPC from userland
☆46Updated 7 years ago
Alternatives and similar repositories for myhadoop:
Users that are interested in myhadoop are comparing it to the libraries listed below
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆197Updated last year
- ☆58Updated 2 years ago
- Grand Unified File-Index☆47Updated this week
- launching and controlling spark on hpc clusters☆23Updated 2 years ago
- hanythingondemand provides a set of scripts to easily set up an ad-hoc Hadoop cluster through PBS jobs☆12Updated 5 years ago
- HPCPerfStats is an automated resource-usage monitoring and analysis package.☆46Updated this week
- Collection of tutorials for using Shifter to bring containers to HPC☆26Updated 5 years ago
- Introduction to Hadoop for those from an HPC simulation background☆31Updated 9 years ago
- Jupyter plugin that provides a tab for TACC Lmod (https://github.com/TACC/Lmod)☆30Updated last month
- ☆28Updated 5 years ago
- Slides and materials for workshop at University of Michigan MICDE☆19Updated 8 years ago
- Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center☆18Updated 4 years ago
- XALT: System tracking of users codes on clusters☆43Updated last month
- Remote Spawner class for JupyterHub to spawn IPython notebooks and a remote server and tunnel the port via SSH☆27Updated 8 years ago
- MPI Testing Tool☆64Updated last month
- Documented examples of Jupyterhub deployment in HPC settings☆36Updated 7 months ago
- ☆97Updated 4 months ago
- ☆19Updated 3 years ago
- HPC System and Software Testing Framework☆68Updated last month
- Deploy Dask on DRMAA clusters☆40Updated 3 years ago
- Custom Spawner for Jupyterhub to start slurm jobs when users log in☆24Updated 2 years ago
- UnifyFS: A file system for burst buffers☆111Updated last month
- IO-500☆37Updated 4 years ago
- Slurm Docker Container on CentOS 7☆88Updated 9 months ago
- gather and plot data about Slurm scheduling and job statistics☆51Updated 10 years ago
- Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark☆42Updated 3 years ago
- Pavilion is a Python 3 (3.5+) based framework for running and analyzing tests targeting HPC systems.☆44Updated this week
- The old ADIOS 1.x code repository. Look for ADIOS2 for new repo☆54Updated 9 months ago
- Machine Learning Toolkit for Extreme Scale (MaTEx)☆111Updated 6 years ago
- Default Repo description from terraform module☆5Updated 5 years ago