trbs / airflow-examples

Related projects ⓘ

Alternatives and complementary repositories for airflow-examples

• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 3 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆75Updated 5 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆68Updated 5 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆173Updated last year
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• danielblazevski / airflow-pyspark-reddit
  Example of using Airflow to schedule downloading data form S3 and launching spark jobs
  ☆15Updated 8 years ago
• postrational / airflow_tutorial
  ☆54Updated 6 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆94Updated 6 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• yennanliu / spark-etl-pipeline
  Various data stream/batch process demo with Apache Scala Spark 🚀
  ☆11Updated 4 years ago
• rogaha / data-processing-pipeline
  Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
  ☆83Updated 7 years ago
• sahilbhange / hive-sql-slowly-changing-dimension
  Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…
  ☆16Updated 5 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• airflow-plugins / airflow-exporter
  Airflow plugin to export dag and task based metrics to Prometheus.
  ☆23Updated 6 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated 2 years ago
• Yannael / kafka-sparkstreaming-cassandra
  Docker container for Kafka - Spark Streaming - Cassandra
  ☆97Updated 5 years ago
• unruly / terraform-aws-airflow
  Terraform module for a PostgreSQL-backed Apache Airflow instance
  ☆24Updated 6 years ago
• cartershanklin / hive-scd-examples
  How to manage Slowly Changing Dimensions with Apache Hive
  ☆55Updated 5 years ago
• harrystech / arthur-redshift-etl
  ELT Code for your Data Warehouse
  ☆26Updated last year
• awesome-spark / learn-by-examples
  Real-world Spark pipelines examples
  ☆83Updated 6 years ago
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆333Updated 6 years ago
• mozilla / emr-bootstrap-spark
  AWS bootstrap scripts for Mozilla's flavoured Spark setup.
  ☆47Updated 4 years ago
• etsy / boundary-layer
  Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform
  ☆262Updated last year
• jrderuiter / airflow-fs
  Composable filesystem hooks and operators for Apache Airflow.
  ☆17Updated 3 years ago
• infOpen / ansible-role-airflow
  Ansible role to deploy and configure Airflow
  ☆41Updated 3 weeks ago
• mahmoudparsian / big-data-mapreduce-course
  Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
  ☆154Updated last week
• astronomer / dynamic-dags-tutorial
  ☆27Updated last year