mrafayaleem / etl-series

Related projects ⓘ

Alternatives and complementary repositories for etl-series

• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• Raybeam / rb_status_plugin
  rb_status_plugin : Data confidence tool for Airflow
  ☆12Updated last year
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆92Updated this week
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆159Updated 3 weeks ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆85Updated 3 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• webysther / aws-glue-docker
  🐋 Docker image for AWS Glue Spark/Python
  ☆22Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• stwind / airflow-on-kubernetes
  Bare minimal Airflow on Kubernetes (Local, EKS, AKS)
  ☆52Updated 4 years ago
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆137Updated this week
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆90Updated 4 years ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆31Updated last year
• Divergent-Insights / dbt-dataquality
  Creates simple data models on Snowflake to report dbt source freshness and tests
  ☆23Updated last year
• dwallace0723 / dbt-cloud-plugin
  DBT Cloud Plugin for Airflow
  ☆38Updated 6 months ago
• dbt-labs / airflow-fivetran-dbt
  Example orchestration pipeline for Fivetran + dbt managed by Airflow
  ☆21Updated 3 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆42Updated 8 months ago
• godatadriven / pytest-dbt-core
  Pytest plugin for dbt core
  ☆58Updated 5 months ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• skhatri / airflow-by-example
  Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes maste…
  ☆22Updated 2 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆66Updated 3 years ago
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆70Updated 3 years ago
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆106Updated 6 months ago
• bhavaniravi / airflow-kube-setup
  How to deploy airflow on Kubernetes
  ☆39Updated last year
• garystafford / emr-demo
  Project files for the post: Running PySpark Applications on Amazon EMR: Methods for Interacting with PySpark on Amazon Elastic MapReduce.
  ☆38Updated 2 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• tuanchris / cloud-data-lake
  Data lake, data warehouse on GCP
  ☆54Updated 2 years ago
• sungchun12 / airflow-toolkit
  Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…
  ☆111Updated last year