anna-geller / dataflow-opsLinks
Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
☆116Updated 2 years ago
Alternatives and similar repositories for dataflow-ops
Users that are interested in dataflow-ops are comparing it to the libraries listed below
Sorting:
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆108Updated 2 years ago
- Snippets and templates representing common Customer Success patterns☆255Updated 10 months ago
- Collection of Prefect integrations for working with dbt with your Prefect flows.☆82Updated last year
- Code examples showing flow deployment to various types of infrastructure☆111Updated 2 years ago
- Example project demonstrating deployment patterns for real-time streaming workflows with Prefect 2.0☆45Updated 3 years ago
- Great Expectations Airflow operator☆169Updated last week
- A web API for dbt.☆111Updated 11 months ago
- Repo for orienting dbt users to the Dagster asset framework☆56Updated 3 years ago
- Dagster Labs' open-source data platform, built with Dagster.☆414Updated this week
- Snowflake Snowpark Python API☆317Updated last week
- Prefect integrations with AWS.☆87Updated last year
- Data pipeline with dbt, Airflow, Great Expectations☆164Updated 4 years ago
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆208Updated 2 weeks ago
- Dagster University courses☆114Updated this week
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆100Updated last year
- All things awesome related to Dagster!☆132Updated last month
- CLI tool for dbt users to simplify creation of staging models (yml and sql) files☆269Updated 2 weeks ago
- A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset☆252Updated last month
- Template Dagster repo using poetry and a single Docker container; works well with CICD☆67Updated 3 years ago
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆223Updated 6 months ago
- A dbt-core python package that automates the management and creation of dbt groups, contracts, access, and versions.☆125Updated 9 months ago
- Possibly the fastest DataFrame-agnostic quality check library in town.☆225Updated 2 weeks ago
- How to use Prefect Deployments with flow code baked into a Docker image☆33Updated 2 years ago
- Prefect integrations with Google Cloud Platform.☆57Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated 2 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆90Updated 2 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 3 years ago
- Contribute to dlt verified sources 🔥☆100Updated 3 weeks ago
- Deploy a Prefect flow to serverless AWS Lambda function☆35Updated 3 years ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆375Updated 5 months ago