jw-ng / airflow-dynamic-dags
☆12Updated 3 years ago
Alternatives and similar repositories for airflow-dynamic-dags
Users that are interested in airflow-dynamic-dags are comparing it to the libraries listed below
Sorting:
- A repository of sample code to show data quality checking best practices using Airflow.☆77Updated 2 years ago
- ☆16Updated last year
- Materials of the Official Helm Chart Webinar☆27Updated 3 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆35Updated last year
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆75Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆52Updated 4 years ago
- ☆18Updated 9 months ago
- Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.☆16Updated 4 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆116Updated 2 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆29Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆68Updated last year
- Data lake, data warehouse on GCP☆56Updated 3 years ago
- Delta Lake Documentation☆49Updated 10 months ago
- A tutorial for the Great Expectations library.☆71Updated 4 years ago
- Utilities to showcase OpenMetadata☆27Updated this week
- Delta Lake examples☆224Updated 7 months ago
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- Dockerizing an Apache Spark Standalone Cluster☆43Updated 2 years ago
- An example dbt project using AutomateDV to create a Data Vault 2.0 Data Warehouse based on the Snowflake TPC-H dataset.☆50Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 9 months ago
- Cloned by the `dbt init` task☆61Updated last year
- A Table format agnostic data sharing framework☆38Updated last year
- Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data☆46Updated last year
- Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market☆58Updated 2 years ago
- Spark app to merge different schemas☆23Updated 4 years ago
- ☆18Updated last year
- Data Engineering with Spark and Delta Lake☆98Updated 2 years ago
- Quick Guides from Dremio on Several topics☆71Updated 4 months ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated last year
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆83Updated last year