hussein-awala / airflow-duckdb
A package to run DuckDB queries from Apache Airflow.
☆14Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for airflow-duckdb
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆191Updated last week
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- ☆99Updated 3 months ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆62Updated last month
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Great Expectations Airflow operator☆159Updated 2 weeks ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆48Updated last year
- ☆14Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆58Updated last year
- Course notes for the Astronomer Certification DAG Authoring for Apache Airflow☆47Updated 7 months ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆25Updated 8 months ago
- Code for dbt tutorial☆143Updated 5 months ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆110Updated 3 months ago
- Make simple storing test results and visualisation of these in a BI dashboard☆39Updated 2 weeks ago
- A dbt-core python package that automates the management and creation of dbt groups, contracts, access, and versions.☆110Updated 4 months ago
- Pytest plugin for dbt core☆57Updated 5 months ago
- Dry run capability for dbt projects using BigQuery☆88Updated 3 months ago
- Airflow Providers containing Deferrable Operators & Sensors from Astronomer☆137Updated last week
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆24Updated 7 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆24Updated last year
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆179Updated 4 months ago
- Tools to handle dbt Jobs as well-defined YAML files☆42Updated last week
- One-stop-shop for docs and test coverage of dbt projects.☆198Updated 4 months ago
- Demo DAGs that show how to run dbt Core in Airflow using Cosmos☆37Updated last month
- (project & tutorial) dag pipeline tests + ci/cd setup☆85Updated 3 years ago
- an ephemeral project repo for the DU Dagster project☆52Updated last week
- Run and schedule dbt commands using Github Actions☆65Updated 6 months ago
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆95Updated last year
- Project for "Data pipeline design patterns" blog.☆41Updated 3 months ago
- Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.☆347Updated last week