wmlba / ECS-Dask
Dask on ECS Fargate
β14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask:
Users that are interested in ECS-Dask are comparing it to the libraries listed below
- π Docker image for AWS Glue Spark/Pythonβ23Updated last year
- Composable filesystem hooks and operators for Apache Airflow.β17Updated 3 years ago
- β19Updated 4 years ago
- Functional Airflow DAG definitions.β38Updated 7 years ago
- A pyspark lib to validate data qualityβ18Updated 2 years ago
- The elegance of Airflow + the power of AWSβ50Updated last year
- A template for an AWS Lambda function that triggers Prefect Flow Runsβ20Updated 3 years ago
- β60Updated 3 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.β111Updated 2 years ago
- β12Updated last year
- Code to be contributed to the Apache Airflow (incubating) project for ETL workflow management for integrating with the Snowflake Data Warβ¦β25Updated 7 years ago
- Dask integration for Snowflakeβ30Updated 4 months ago
- dbt adwords modelsβ17Updated last month
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMRβ31Updated last month
- Using the Parquet file format with Pythonβ15Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formatsβ29Updated last year
- β22Updated 4 years ago
- A CLI to manage and monitor permissions in AWS Lake Formationβ27Updated 2 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, β¦β83Updated last year
- Repository to maintain infrastructure to automate Data Workflowsβ34Updated 3 years ago
- β16Updated 2 years ago
- β30Updated last year
- Glue VSCode devcontainer setupβ14Updated 2 years ago
- Airflow code accompanying blog post.β21Updated 6 years ago
- An extention to json_normalize() in pandasβ27Updated 4 years ago
- Contains example dags and terraform code to create a composer with a node pool to run podsβ13Updated 4 years ago
- β11Updated 4 months ago
- Visualize dependencies between Airflow DAGsβ49Updated 3 years ago
- Pylint plugin for static code analysis on Airflow codeβ93Updated 4 years ago
- A collection of python utility functionsβ11Updated 8 months ago