Alternatives and similar repositories for airflow-pipeline:

Users that are interested in airflow-pipeline are comparing it to the libraries listed below

• danielvdende / data-testing-with-airflow
  ☆199Updated last year
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• rolanddb / airflow-on-kubernetes
  A guide to running Airflow on Kubernetes
  ☆173Updated 5 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆100Updated 4 years ago
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆258Updated 2 years ago
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆396Updated last year
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆340Updated 6 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆233Updated 2 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆65Updated 4 years ago
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆325Updated 4 years ago
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆200Updated last week
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 4 years ago
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆132Updated last year
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• TomLous / medium-spark-k8s
  Spark on Kubernetes using Helm
  ☆34Updated 4 years ago
• julioasotodv / spark-df-profiling
  Create HTML profiling reports from Apache Spark DataFrames
  ☆196Updated 5 years ago
• margitaii / pydeequ
  Python API for Deequ
  ☆41Updated 4 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• panovvv / hadoop-hive-spark-docker
  Base Docker image with just essentials: Hadoop, Hive and Spark.
  ☆69Updated 4 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆98Updated 2 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 7 months ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 2 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆183Updated 3 months ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated 10 months ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆223Updated last month
• MarquezProject / marquez-airflow
  Airflow support for Marquez
  ☆32Updated 4 years ago