trbs / airflow-examples

Related projects: ⓘ

• tfayyaz / awesome-airflow
  A curated list of all the awesome examples, articles, tutorials and videos for Apache Airflow.
  ☆96Updated 3 years ago
• danielblazevski / airflow-pyspark-reddit
  Example of using Airflow to schedule downloading data form S3 and launching spark jobs
  ☆15Updated 7 years ago
• bahchis / airflow-cookbook
  Airflow workflow management platform chef cookbook.
  ☆67Updated 5 years ago
• blue-yonder / airflow-plugin-demo
  Example for an airflow plugin
  ☆49Updated 8 years ago
• airflow-plugins / airflow_api_plugin
  REST-like API exposing Airflow data and operations
  ☆61Updated 5 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 6 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• rssanders3 / airflow-spark-operator-plugin
  A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator
  ☆75Updated 5 years ago
• dsaidgovsg / airflow-pipeline
  An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR
  ☆171Updated 10 months ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 5 years ago
• airflow-plugins / Getting-Started
  A Getting Started Guide for developing and using Airflow Plugins
  ☆94Updated 5 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 7 years ago
• rogaha / data-processing-pipeline
  Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra
  ☆86Updated 7 years ago
• groupon / luigi-warehouse
  A luigi powered analytics / warehouse stack
  ☆87Updated 7 years ago
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 3 years ago
• luisbelloch / data_processing_course
  Some class materials for a data processing course using PySpark
  ☆51Updated last year
• postrational / airflow_tutorial
  ☆54Updated 5 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆71Updated last year
• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆333Updated 6 years ago
• bitnami / bitnami-docker-airflow-worker
  ☆32Updated this week
• amwaleh / Simple-stream-Kafka
  This is a simple streaming application that utilises Kafka and Python
  ☆45Updated 5 years ago
• kaantas / spark-twitter-sentiment-analysis
  Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
  ☆54Updated 5 years ago
• Mageswaran1989 / awesome-ApacheSpark-collections
  A curated list of awesome Apache Spark packages and resources.
  ☆40Updated 7 years ago
• astronomerio-archive / docker-airflow
  ☆20Updated this week
• datitran / emr-bootstrap-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR
  ☆53Updated 7 years ago
• teamclairvoyant / airflow-user-management-plugin
  A plugin for Apache Airflow that allows you to manage the users that can login
  ☆14Updated 4 years ago
• capitalone / locopy
  locopy: Loading/Unloading to Redshift and Snowflake using Python.
  ☆104Updated last week
• vishalsatam / Data-Pipelining
  ☆26Updated 3 years ago
• alexvanboxel / airflow-gcp-k8s
  ☆54Updated 7 years ago