wmlba / ECS-DaskLinks
Dask on ECS Fargate
☆14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask
Users that are interested in ECS-Dask are comparing it to the libraries listed below
Sorting:
- Dask integration for Snowflake☆30Updated 7 months ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 3 years ago
- ☆19Updated 5 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆38Updated 4 months ago
- Run dbt serverless in the Cloud (AWS)☆42Updated 5 years ago
- ☆61Updated 3 years ago
- a pytest plugin for dbt adapter test suites☆19Updated last year
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆23Updated 9 months ago
- The elegance of Airflow + the power of AWS☆50Updated last year
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated last week
- DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters☆22Updated 3 years ago
- Using the Parquet file format with Python☆15Updated last year
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- ☆30Updated 3 months ago
- ☆11Updated 7 months ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- A collection of python utility functions☆11Updated 11 months ago
- ☆12Updated last year
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- Cloudformation templates for deploying Airflow in ECS☆40Updated 6 years ago
- How to run DBT on AWS Fargate☆13Updated 5 years ago
- Contains example dags and terraform code to create a composer with a node pool to run pods☆13Updated 4 years ago
- Repository to maintain infrastructure to automate Data Workflows☆35Updated 4 years ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆64Updated last year
- Read Delta tables without any Spark☆47Updated last year
- A pyspark lib to validate data quality☆18Updated 2 years ago
- Ibis analytics, with Ibis (and more!)☆22Updated 9 months ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…☆75Updated 6 years ago