wmlba / ECS-Dask
Dask on ECS Fargate
☆14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask:
Users that are interested in ECS-Dask are comparing it to the libraries listed below
- Repository to maintain infrastructure to automate Data Workflows☆35Updated 4 years ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 3 years ago
- ☆19Updated 5 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆36Updated 2 months ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 3 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- ☆53Updated last year
- The elegance of Airflow + the power of AWS☆50Updated last year
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago
- Run dbt serverless in the Cloud (AWS)☆42Updated 5 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- ☆60Updated 3 years ago
- rb_status_plugin : Data confidence tool for Airflow☆12Updated 2 years ago
- Dask integration for Snowflake☆30Updated 5 months ago
- An infrastructure as code approach to deploying Snowflake using Terraform☆25Updated last year
- dbt adwords models☆18Updated 3 months ago
- Glue VSCode devcontainer setup☆14Updated 2 years ago
- ☆14Updated 4 years ago
- Pylint plugin for static code analysis on Airflow code☆93Updated 4 years ago
- Contains example dags and terraform code to create a composer with a node pool to run pods☆13Updated 4 years ago
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- A pyspark lib to validate data quality☆18Updated 2 years ago
- How to run DBT on AWS Fargate☆13Updated 5 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 2 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- a pytest plugin for dbt adapter test suites☆19Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- dbt adapter for Athena☆38Updated 11 months ago