jtriley / StarCluster
StarCluster is an open source cluster-computing toolkit for Amazon's Elastic Compute Cloud (EC2).
☆582Updated 2 years ago
Related projects: ⓘ
- Create clusters of VMs on the cloud and configure them with Ansible.☆335Updated last year
- Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for L…☆191Updated 9 months ago
- StarCluster is a utility for creating and managing computing clusters hosted on Amazon's Elastic Compute Cloud (EC2).☆37Updated 4 years ago
- ☆87Updated this week
- build and test recipes for conda☆327Updated last year
- AWS ParallelCluster is an AWS supported Open Source cluster management tool to deploy and manage HPC clusters in the AWS cloud.☆827Updated this week
- Framework for deploying Hadoop clusters on traditional HPC from userland☆46Updated 6 years ago
- Docker containers for the IPython notebook (+SciPy Stack)☆188Updated 8 years ago
- vbench: A tool for benchmarking your code through time, for showing performance improvement or regressions☆246Updated 6 years ago
- A light-weight wrapper library around Spotify's Luigi workflow library to make writing scientific workflows more fluent, flexible and mod…☆332Updated last year
- Shifter - Linux Containers for HPC☆348Updated 5 months ago
- SLURM: A Highly Scalable Resource Manager☆64Updated 7 years ago
- Distributed Numpy☆148Updated 6 years ago
- Slurm on Google Cloud Platform☆178Updated this week
- ☆388Updated this week
- Default Repo description from terraform module☆5Updated 5 years ago
- The configuration and scripts for using spark within a Sun Grid Engine environment☆23Updated 10 years ago
- reproducible executable environments☆443Updated 6 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 5 years ago
- Unified interface for local and distributed ndarrays☆158Updated 5 years ago
- Run IPython notebooks as command-line scripts, generate HTML reports☆451Updated 6 years ago
- Partitioned storage system based on blosc. **No longer actively maintained.**☆153Updated 7 years ago
- Univa Grid Engine Open Core☆92Updated 12 years ago
- Run singularity containers on the Comet Supercomputer at San Diego Supercomputer Center☆18Updated 4 years ago
- gather and plot data about Slurm scheduling and job statistics☆50Updated 9 years ago
- The Chef cookbook used to build and bootstrap AWS ParallelCluster☆107Updated this week
- Supporting Hierarchical Data Format and Rich Parallel I/O Interface in Spark☆42Updated 3 years ago
- ☆78Updated this week
- Simplifying robust end-to-end machine learning on Apache Spark.☆468Updated 7 years ago
- A Python wrapper for Cascading☆222Updated 4 years ago