tuanavu / airflow-tutorial

Related projects: ⓘ

• BasPH / data-pipelines-with-apache-airflow
  Code for Data Pipelines with Apache Airflow
  ☆696Updated last month
• gtoonstra / etl-with-airflow
  ETL best practices with airflow, with examples
  ☆1,282Updated 2 years ago
• astronomer / airflow-guides
  Guides and docs to help you get up and running with Apache Airflow.
  ☆798Updated last year
• hgrif / airflow-tutorial
  Airflow basics tutorial
  ☆397Updated 3 years ago
• jghoman / awesome-apache-airflow
  Curated list of resources about Apache Airflow
  ☆3,653Updated 3 weeks ago
• teamclairvoyant / airflow-maintenance-dags
  A series of DAGs/Workflows to help maintain the operation of Airflow
  ☆1,652Updated 3 months ago
• AlexIoannides / pyspark-example-project
  Implementing best practices for PySpark ETL jobs and applications.
  ☆1,631Updated last year
• cluster-apps-on-docker / spark-standalone-cluster-on-docker
  Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.
  ☆445Updated last year
• astronomer / dag-factory
  Dynamically generate Apache Airflow DAGs from YAML configuration files
  ☆1,158Updated last week
• puckel / docker-airflow
  Docker Apache Airflow
  ☆3,765Updated last year
• renatootescu / ETL-pipeline
  Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.
  ☆290Updated 2 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆239Updated last year
• spark-examples / pyspark-examples
  Pyspark RDD, DataFrame and Dataset Examples in Python language
  ☆1,148Updated 5 months ago
• shafiab / HashtagCashtag
  My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggrega…
  ☆474Updated 2 years ago
• damklis / DataEngineeringProject
  Example end to end data engineering project.
  ☆1,102Updated last year
• josephmachado / beginner_de_project
  Beginner data engineering project - batch edition
  ☆456Updated 2 weeks ago
• ankurchavda / streamify
  A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
  ☆544Updated 2 years ago
• abhishek-ch / around-dataengineering
  A Data Engineering & Machine Learning Knowledge Hub
  ☆1,107Updated 7 months ago
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆138Updated 4 years ago
• cartershanklin / pyspark-cheatsheet
  PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
  ☆408Updated 2 months ago
• san089 / goodreads_etl_pipeline
  An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
  ☆1,272Updated 4 years ago
• databricks / LearningSparkV2
  This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
  ☆1,172Updated 4 months ago
• xnuinside / airflow_in_docker_compose
  Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
  ☆184Updated 9 months ago
• LearningJournal / Spark-Programming-In-Python
  Apache Spark 3 - Spark Programming in Python for Beginners
  ☆362Updated last month
• kevinschaich / pyspark-cheatsheet
  🐍 Quick reference guide to common patterns & functions in PySpark.
  ☆408Updated last year
• PacktPublishing / Data-Engineering-with-Python
  Data Engineering with Python, published by Packt
  ☆602Updated last year
• Flor91 / Data-engineering-nanodegree
  Projects done in the Data Engineering Nanodegree by Udacity.com
  ☆267Updated 5 years ago
• soggycactus / airflow-repo-template
  The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.
  ☆237Updated 3 years ago
• airflow-plugins / Example-Airflow-DAGs
  Example DAGs using hooks and operators from Airflow Plugins
  ☆333Updated 6 years ago
• nareshk1290 / Udacity-Data-Engineering
  Udacity Data Engineering Nano Degree (DEND)
  ☆183Updated 4 years ago