wmlba / ECS-Dask
Dask on ECS Fargate
β14Updated 5 years ago
Alternatives and similar repositories for ECS-Dask:
Users that are interested in ECS-Dask are comparing it to the libraries listed below
- β19Updated 5 years ago
- β60Updated 3 years ago
- π Docker image for AWS Glue Spark/Pythonβ23Updated last year
- β30Updated last month
- A template for an AWS Lambda function that triggers Prefect Flow Runsβ20Updated 3 years ago
- A project template for developing BYOD docker images for use in Amazon SageMaker.β19Updated 5 years ago
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analyticsβ64Updated last year
- The open source version of the Amazon Redshift Cluster Management Guide.β48Updated last year
- Tools for making Prefect work better for typical data science workflowsβ19Updated 3 years ago
- This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concuβ¦β75Updated 6 years ago
- Functional Airflow DAG definitions.β38Updated 7 years ago
- Dask integration for Snowflakeβ30Updated 5 months ago
- A VS Code Extension to make it easier to manage and develop Spark jobs on EMRβ35Updated last month
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3β23Updated 7 months ago
- β52Updated 6 years ago
- The open source version of the Amazon Athena documentation. To submit feedback & requests for changes, submit issues in this repository, β¦β82Updated last year
- The elegance of Airflow + the power of AWSβ50Updated last year
- A CLI to manage and monitor permissions in AWS Lake Formationβ27Updated 2 years ago
- Using the Parquet file format with Pythonβ15Updated last year
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.β22Updated 9 years ago
- Build and deploy a serverless data pipeline on AWS with no effort.β111Updated 2 years ago
- This repository shows a sample example to build, manage and orchestrate Machine Learning workflows using Amazon Sagemaker and Apache Airfβ¦β136Updated 3 years ago
- Customizable GitOps template for Kubeflow on AWS EKSβ10Updated 4 years ago
- Example templates for the delivery of custom ML solutions to production so you can get started quickly without having to make too many deβ¦β71Updated 9 months ago
- How to create powerful AWS lambda python function that fits in a 250Mb packageβ34Updated 7 years ago
- AWS Blog post code for running feature-extraction on images using AWS Batch and Cloud Development Kit (CDK).β20Updated 2 years ago
- Cloudformation templates for deploying Airflow in ECSβ40Updated 6 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.β47Updated last year
- Docker images that replicate the Amazon SageMaker Notebook instance.β58Updated 3 years ago
- β19Updated 3 years ago