wmlba / ECS-Dask
Dask on ECS Fargate
☆14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask:
Users that are interested in ECS-Dask are comparing it to the libraries listed below
- ☆19Updated 4 years ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 3 years ago
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆21Updated 5 months ago
- The elegance of Airflow + the power of AWS☆50Updated last year
- ☆30Updated 3 weeks ago
- ☆14Updated 3 years ago
- Run dbt serverless in the Cloud (AWS)☆41Updated 5 years ago
- ☆30Updated 10 months ago
- Using the Parquet file format with Python☆15Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formation☆26Updated 2 years ago
- A pyspark lib to validate data quality☆18Updated 2 years ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMR☆30Updated this week
- Build and deploy a serverless data pipeline on AWS with no effort.☆111Updated 2 years ago
- ☆60Updated 3 years ago
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated last year
- ☆11Updated 3 months ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Design pattern for orchestrating an incremental data ingestion pipeline using AWS Step Functions from an on premise location into an Amaz…☆28Updated 5 years ago
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated last year
- Hackney Data Platform Infrastructure and Code☆17Updated this week
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- ☆16Updated last year
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- Git repo to accompany the AWS DevOps Blog: Using AWS DevOps Tools to model and provision AWS Glue workflows☆19Updated 3 years ago
- Dask integration for Snowflake☆30Updated 3 months ago
- AWS Blog post code for running feature-extraction on images using AWS Batch and Cloud Development Kit (CDK).☆20Updated 2 years ago
- A collection of python utility functions☆11Updated 7 months ago
- ☆12Updated 11 months ago
- Demo for GitHub Universe 2022☆12Updated 2 years ago