BasPH / data-pipelines-with-apache-airflow

Related projects ⓘ

Alternatives and complementary repositories for data-pipelines-with-apache-airflow

• tuanavu / airflow-tutorial
  Apache Airflow tutorial
  ☆933Updated 2 years ago
• cartershanklin / pyspark-cheatsheet
  PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
  ☆422Updated 3 weeks ago
• josephmachado / beginner_de_project
  Beginner data engineering project - batch edition
  ☆469Updated 2 months ago
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆235Updated 3 months ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆242Updated last year
• AlexIoannides / pyspark-example-project
  Implementing best practices for PySpark ETL jobs and applications.
  ☆1,682Updated last year
• astronomer / airflow-guides
  Guides and docs to help you get up and running with Apache Airflow.
  ☆799Updated 2 years ago
• renatootescu / ETL-pipeline
  Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.
  ☆296Updated 2 years ago
• PacktPublishing / Data-Engineering-with-Python
  Data Engineering with Python, published by Packt
  ☆618Updated last year
• ankurchavda / streamify
  A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
  ☆569Updated 2 years ago
• damklis / DataEngineeringProject
  Example end to end data engineering project.
  ☆1,138Updated last year
• jamesdensmore / datapipelinesbook
  ☆169Updated 3 years ago
• coder2j / airflow-docker
  Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)
  ☆271Updated 8 months ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆131Updated 4 years ago
• astronomer / dag-factory
  Dynamically generate Apache Airflow DAGs from YAML configuration files
  ☆1,197Updated this week
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆138Updated 4 years ago
• nordquant / complete-dbt-bootcamp-zero-to-hero
  Supplementary Materials for the The Complete dbt (Data Build Tool) Bootcamp Udemy course
  ☆450Updated 2 weeks ago
• kevinschaich / pyspark-cheatsheet
  🐍 Quick reference guide to common patterns & functions in PySpark.
  ☆446Updated last year
• soggycactus / airflow-repo-template
  The easiest way to run Airflow locally, with linting & tests for valid DAGs and Plugins.
  ☆240Updated 3 years ago
• PacktPublishing / Data-Engineering-with-AWS
  Data Engineering with AWS, Published by Packt
  ☆311Updated last year
• RSKriegs / finnhub-streaming-data-pipeline
  Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
  ☆293Updated 11 months ago
• alanchn31 / Data-Engineering-Projects
  Personal Data Engineering Projects
  ☆852Updated last year
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆133Updated 4 years ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆239Updated last month
• ssp-data / practical-data-engineering
  Practical Data Engineering: A Hands-On Real-Estate Project Guide
  ☆528Updated 2 months ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆170Updated 2 years ago
• gtoonstra / etl-with-airflow
  ETL best practices with airflow, with examples
  ☆1,293Updated last month
• Flor91 / Data-engineering-nanodegree
  Projects done in the Data Engineering Nanodegree by Udacity.com
  ☆269Updated 5 years ago
• shafiab / HashtagCashtag
  My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on ​lambda architecture​, that aggrega…
  ☆485Updated 2 years ago