Alternatives and similar repositories for airflow-pipeline:

Users that are interested in airflow-pipeline are comparing it to the libraries listed below

• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆73Updated 5 years ago
• danielvdende / data-testing-with-airflow
  ☆196Updated last year
• teamclairvoyant / airflow-rest-api-plugin
  A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
  ☆325Updated 4 years ago
• chandulal / airflow-testing
  Airflow Unit Tests and Integration Tests
  ☆256Updated 2 years ago
• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 4 years ago
• teamclairvoyant / airflow-scheduler-failover-controller
  A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
  ☆232Updated 2 years ago
• AnkurChoraywal / airflow-backfill-util
  Airflow Backfill UI based plugin for existing / new Airflow environment
  ☆66Updated 4 years ago
• rambler-digital-solutions / airflow-declarative
  Airflow declarative DAGs via YAML
  ☆132Updated last year
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆84Updated 6 years ago
• astronomer / ap-airflow
  Astronomer Core Docker Images
  ☆106Updated 7 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆186Updated last year
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆261Updated last year
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• qubole / kinesis-sql
  Kinesis Connector for Structured Streaming
  ☆136Updated 6 months ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆69Updated 5 years ago
• hgrif / airflow-tutorial
  Airflow basics tutorial
  ☆398Updated 3 years ago
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆334Updated 6 years ago
• spark-redshift-community / spark-redshift
  Performant Redshift data source for Apache Spark
  ☆137Updated last week
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆91Updated 4 years ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆115Updated 2 years ago
• xnuinside / airflow_in_docker_compose
  Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
  ☆183Updated last year
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆205Updated 10 months ago
• FRosner / drunken-data-quality
  Spark package for checking data quality
  ☆221Updated 4 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆178Updated last year
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆97Updated last year
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆195Updated last month
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆143Updated last year
• aws-samples / aws-concurrent-data-orchestration-pipeline-emr-livy
  This code demonstrates the architecture featured on the AWS Big Data blog (https://aws.amazon.com/blogs/big-data/ ) which creates a concu…
  ☆76Updated 6 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆205Updated last month