anna-geller / dataflow-opsLinks
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
☆116Updated 2 years ago
Alternatives and similar repositories for dataflow-ops
Users that are interested in dataflow-ops are comparing it to the libraries listed below
Sorting:
- Snippets and templates representing common Customer Success patterns☆253Updated 9 months ago
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆105Updated 2 years ago
- Code examples showing flow deployment to various types of infrastructure☆109Updated 2 years ago
- Collection of Prefect integrations for working with dbt with your Prefect flows.☆82Updated last year
- Prefect integrations with AWS.☆87Updated last year
- Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0☆45Updated 3 years ago
- Great Expectations Airflow operator☆167Updated last week
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- ☆74Updated last year
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- Deploy a Prefect flow to serverless AWS Lambda function☆35Updated 3 years ago
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆220Updated 5 months ago
- Template to quickly bootstrap a Prefect Collection☆68Updated last year
- How to use Prefect Deployments with flow code baked into a Docker image☆33Updated 2 years ago
- Snowflake Snowpark Python API☆315Updated this week
- A web API for dbt.☆111Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆245Updated 7 months ago
- ☆79Updated 3 weeks ago
- Dry run capability for dbt projects using BigQuery☆100Updated 5 months ago
- Pocket data flows orchestrated using Prefect☆48Updated 6 months ago
- A template repository with all the fundamentals needed to develop and deploy a Python data-processing routine for Prefect pipelines.☆20Updated 3 years ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆375Updated 4 months ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆12Updated this week
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year
- Repo for orienting dbt users to the Dagster asset framework☆55Updated 2 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated 2 years ago
- New generation opensource data stack☆73Updated 3 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆88Updated 2 years ago
- Template Dagster repo using poetry and a single Docker container; works well with CICD☆67Updated 3 years ago
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆99Updated 11 months ago