pywren / examples
Stand-alone pywren examples
☆63Updated 5 years ago
Related projects: ⓘ
- Scripts and instructions to facilitate running Deep Learning Tasks on Amazon EMR☆62Updated 10 months ago
- AWS Batch helpers is a collection of scripts and tools that can be used with AWS Batch.☆133Updated 4 years ago
- Apache Spark on AWS Lambda☆151Updated last year
- Staging area for ongoing enhancements to Ray focused on improving integration with AWS and other Amazon technologies.☆66Updated 8 months ago
- T4 is now in production as Quilt 3☆64Updated 5 years ago
- Spawns JupyterHub single user servers in Docker containers running in AWS Fargate☆46Updated 4 years ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆130Updated this week
- Convert JSON files to Parquet using PyArrow☆94Updated 8 months ago
- Teraflops and microservices☆845Updated 7 months ago
- Reference Lambda function that predicts image labels for a image using an MXNet-built deep learning model. The repo also has pre-built MX…☆131Updated last year
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆22Updated 8 years ago
- Various workshop labs that make use of pywren to massively process data in parallel with AWS Lambda☆38Updated 4 years ago
- Deploy dask on YARN clusters☆69Updated last month
- A Data Platform built for AWS, powered by Kubernetes.☆127Updated last year
- Export Redshift data and convert to Parquet for use with Redshift Spectrum or other data warehouses.☆116Updated last year
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆86Updated last year
- Simple multi-threaded Kinesis Poster and Worker Python examples☆69Updated 9 years ago
- This repo presents a reference architecture for running serverless MapReduce jobs. This has been implemented using AWS Lambda and Amazon …☆428Updated last year
- PyAthenaJDBC is an Amazon Athena JDBC driver wrapper for the Python DB API 2.0 (PEP 249).☆95Updated last year
- Create Parquet files from CSV☆67Updated 7 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 5 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆76Updated 5 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated 11 months ago
- A python library to run your existing code on AWS Batch☆71Updated 5 months ago
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆53Updated 6 years ago
- Python AWS Kinesis Producer with error handling and thread support.☆45Updated last year
- ☆53Updated 11 months ago
- Low level, multiprocessing based AWS Kinesis producer & consumer library☆117Updated 4 months ago
- Distributed training using Kubeflow on Amazon EKS☆79Updated last week
- An EC2 Container Service Architecture which provides the infrastructure for Deep Learning☆69Updated 7 years ago