maikelpenz / dataflow-automation-infraLinks
Repository to maintain infrastructure to automate Data Workflows
☆35Updated 4 years ago
Alternatives and similar repositories for dataflow-automation-infra
Users that are interested in dataflow-automation-infra are comparing it to the libraries listed below
Sorting:
- A simple key/value store built on Prefect☆22Updated 2 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- Collection of code snippets for blogs, conferences, and talks☆24Updated 2 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- Code examples showing flow deployment to various types of infrastructure☆110Updated 2 years ago
- The easiest way to integrate Kedro and Great Expectations☆54Updated 2 years ago
- Python client for using Prefect Cloud with Saturn Cloud☆17Updated last month
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 3 years ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- Deploy a Prefect flow to serverless AWS Lambda function☆35Updated 3 years ago
- kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.☆28Updated 2 years ago
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆44Updated this week
- A data modelling layer built on top of polars and pydantic☆198Updated 2 years ago
- ☆74Updated last year
- Fugue collections for Prefect 2.0☆38Updated 2 years ago
- Snippets and templates representing common Customer Success patterns☆254Updated 9 months ago
- Collection of Prefect integrations for working with dbt with your Prefect flows.☆82Updated last year
- An extension to add Prefect flow visualizations into you Sphinx documentation.☆13Updated 3 years ago
- Prefect integrations for working with Docker☆42Updated last year
- Prefect integrations with AWS.☆87Updated last year
- Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate☆116Updated 2 years ago
- ☆23Updated last year
- Lossless in-memory compression of pandas DataFrames and Series powered by the visions type system. Up to 10x less RAM needed for the same…☆30Updated 2 years ago
- Template to quickly bootstrap a Prefect Collection☆68Updated last year
- Pocket data flows orchestrated using Prefect☆48Updated 7 months ago
- Bulwark is a package for convenient property-based testing of pandas dataframes.☆226Updated 5 years ago
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆81Updated last year
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated last week
- Type System for Data Analysis in Python☆213Updated 8 months ago
- Kedro-Accelerator speeds up pipelines by parallelizing I/O in the background.☆36Updated 3 years ago