maikelpenz / dataflow-automation-infra
Repository to maintain infrastructure to automate Data Workflows
☆34Updated 3 years ago
Alternatives and similar repositories for dataflow-automation-infra:
Users that are interested in dataflow-automation-infra are comparing it to the libraries listed below
- Collection of code snippets for blogs, conferences, and talks☆23Updated 2 years ago
- Tools for making Prefect work better for typical data science workflows☆19Updated 3 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆104Updated 2 years ago
- A very simple "hello world" project for deploying Prefect 2 to a docker container on Google Compute Engine.☆11Updated 2 years ago
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 2 years ago
- The easiest way to integrate Kedro and Great Expectations☆53Updated 2 years ago
- ☆73Updated 7 months ago
- An extension to add Prefect flow visualizations into you Sphinx documentation.☆13Updated 3 years ago
- A multi-process task runner for Prefect☆14Updated last year
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated this week
- Fugue collections for Prefect 2.0☆38Updated last year
- Deploy a Prefect flow to serverless AWS Lambda function☆36Updated 2 years ago
- Dask integration for Snowflake☆30Updated 4 months ago
- Prefect integrations for working with Docker☆43Updated 10 months ago
- Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate☆113Updated last year
- Prefect API Authentication/Authorization Proxy for on-premises deployments☆38Updated 3 months ago
- A simple key/value store built on Prefect☆22Updated last year
- ☆22Updated last year
- Prefect integrations with Google Cloud Platform.☆58Updated 10 months ago
- kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.☆27Updated 2 years ago
- Notebooks that support blog posts and tech talks on Dask / Coiled.☆47Updated 2 weeks ago
- Prefect integrations with AWS.☆86Updated 10 months ago
- Automatically export Jupyter notebooks to various file formats (.py, .html, and more) on save.☆75Updated last year
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆80Updated 10 months ago
- Prefect integrations with the Dask execution framework.☆67Updated 10 months ago
- Collection of Prefect integrations for working with dbt with your Prefect flows.☆83Updated 10 months ago
- Prefect integrations with SQLAlchemy.☆25Updated 10 months ago
- Template to quickly bootstrap a Prefect Collection☆68Updated 6 months ago
- ☆21Updated 7 months ago