Alternatives and similar repositories for airflow-pipeline

Users that are interested in airflow-pipeline are comparing it to the libraries listed below

• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• ekampf / PySpark-Boilerplate
  A boilerplate for writing PySpark Jobs
  ☆395Updated last year
• danielvdende / data-testing-with-airflow
  ☆199Updated last year
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆341Updated 6 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆71Updated 5 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆100Updated 4 years ago
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆326Updated 4 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆98Updated 2 years ago
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 4 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• testdrivenio / spark-kubernetes
  spark on kubernetes
  ☆104Updated 2 years ago
• MarquezProject / marquez-airflow
  Airflow support for Marquez
  ☆32Updated 4 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆107Updated last year
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆65Updated 4 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆205Updated last year
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 5 years ago
• xnuinside / airflow_in_docker_compose
  Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
  ☆186Updated last year
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆93Updated 6 years ago
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 4 years ago
• hgrif / airflow-tutorial
  Airflow basics tutorial
  ☆397Updated 3 years ago
• JahstreetOrg / spark-on-kubernetes-helm
  Spark on Kubernetes infrastructure Helm charts repo
  ☆203Updated 2 years ago
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆132Updated last year
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 7 years ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 2 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆261Updated last year
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆259Updated 2 years ago
• vaquarkhan / Apache-Kafka-poc-and-notes
  ☆247Updated 5 years ago
• BrechtDeVlieger / airflow-kube-helm
  ☆127Updated 4 years ago