wmlba / ECS-DaskLinks
Dask on ECS Fargate
☆14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask
Users that are interested in ECS-Dask are comparing it to the libraries listed below
Sorting:
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- The elegance of Airflow + the power of AWS☆51Updated last year
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 4 years ago
- ☆15Updated 4 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- ☆62Updated 3 years ago
- Functional Airflow DAG definitions.☆38Updated 8 years ago
- ☆16Updated 2 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆38Updated 6 months ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- ☆31Updated last year
- ☆30Updated 6 months ago
- An extension to the Amazon SQS client that enables sending and receiving messages up to 2GB via Amazon S3.☆48Updated 11 months ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Docker images that replicate the Amazon SageMaker Notebook instance.☆58Updated 3 years ago
- Airflow Executor for both AWS ECS & AWS Fargate☆52Updated 2 years ago
- ☆19Updated 5 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆84Updated 2 years ago
- This repository contains ready-to-use notebook examples for a wide variety of use cases in Amazon EMR Studio.☆52Updated last year
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 4 years ago
- A nicer UI for AWS Glue Data Catalog☆10Updated 3 years ago
- Spark runtime on AWS Lambda☆109Updated this week
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆77Updated 6 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆24Updated 11 months ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆144Updated 3 weeks ago
- rb_status_plugin : Data confidence tool for Airflow☆12Updated 2 years ago
- ☆11Updated last year
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated 2 years ago