wmlba / ECS-Dask
Dask on ECS Fargate
☆14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask:
Users that are interested in ECS-Dask are comparing it to the libraries listed below
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆30Updated 4 months ago
- ☆19Updated 4 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆20Updated 4 months ago
- ☆30Updated last year
- ☆53Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- ☆14Updated 3 years ago
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 3 years ago
- ☆29Updated 9 months ago
- The elegance of Airflow + the power of AWS☆50Updated 11 months ago
- Dask integration for Snowflake☆30Updated 2 months ago
- ☆22Updated 4 years ago
- Using the Parquet file format with Python☆15Updated last year
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆22Updated 9 years ago
- ☆52Updated 5 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, …☆84Updated last year
- ☆60Updated 3 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated last year
- A self-paced workshop designed to allow you to get hands on with building a real-time data platform using serverless technologies such as…☆22Updated 6 years ago
- CLI tool to launch Spark jobs on AWS EMR☆67Updated last year
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Run dbt serverless in the Cloud (AWS)☆41Updated 4 years ago
- Fully unit tested utility functions for data engineering. Python 3 only.☆15Updated 4 months ago
- Cloudformation templates for deploying Airflow in ECS