wmlba / ECS-DaskLinks
Dask on ECS Fargate
☆14Updated 6 years ago
Alternatives and similar repositories for ECS-Dask
Users that are interested in ECS-Dask are comparing it to the libraries listed below
Sorting:
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 4 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.☆110Updated 3 years ago
- ☆19Updated 5 years ago
- The elegance of Airflow + the power of AWS☆52Updated 2 years ago
- ☆15Updated 4 years ago
- Composable filesystem hooks and operators for Apache Airflow.☆17Updated 4 years ago
- ☆31Updated 2 years ago
- DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters☆22Updated 4 years ago
- Deployment tools/scripts for Metaflow!☆56Updated 2 years ago
- Build and Deploy A Serverless Data Pipeline on AWS☆26Updated 3 years ago
- Make working with pandas data and AWS DynamoDB easy☆21Updated last year
- Dask integration for Snowflake☆30Updated 6 months ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- ☆16Updated 2 years ago
- Functional Airflow DAG definitions.☆38Updated 8 years ago
- Simple samples for writing ETL transform scripts in Python☆24Updated 3 weeks ago
- A small Python module containing quick utility functions for standard ETL processes.☆37Updated last month
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆83Updated last year
- A collection of python utility functions☆11Updated this week
- 🐋 Docker image for AWS Glue Spark/Python☆23Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated 2 years ago
- Different ways to deploy and run the FastAPI framework on AWS☆37Updated 4 years ago
- Parquet file management in S3 for Athena / Spectrum / Presto partitioning☆22Updated last year
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- Deploy a Prefect flow to serverless AWS Lambda function☆35Updated 3 years ago
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated 3 months ago
- T4 is now in production as Quilt 3☆64Updated 6 years ago
- Pylint plugin for static code analysis on Airflow code☆97Updated 5 years ago
- Automated testing and deployment of a simple Flask-based (RESTful) micro-service to a production-like environment on AWS, using Docker co…☆43Updated 3 years ago
- Pocket data flows orchestrated using Prefect☆48Updated 3 weeks ago