BasPH / data-pipelines-with-apache-airflow

Related projects ⓘ

Alternatives and complementary repositories for data-pipelines-with-apache-airflow

• PacktPublishing / Data-Engineering-with-Python
  Data Engineering with Python, published by Packt
  ☆622Updated last year
• renatootescu / ETL-pipeline
  Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.
  ☆297Updated 2 years ago
• cartershanklin / pyspark-cheatsheet
  PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
  ☆424Updated last month
• josephmachado / beginner_de_project
  Beginner data engineering project - batch edition
  ☆473Updated 2 months ago
• ankurchavda / streamify
  A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!
  ☆575Updated 2 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆245Updated last year
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆241Updated 4 months ago
• tuanavu / airflow-tutorial
  Apache Airflow tutorial
  ☆934Updated 2 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆133Updated 4 years ago
• damklis / DataEngineeringProject
  Example end to end data engineering project.
  ☆1,140Updated last year
• astronomer / dag-factory
  Dynamically generate Apache Airflow DAGs from YAML configuration files
  ☆1,209Updated this week
• astronomer / airflow-guides
  Guides and docs to help you get up and running with Apache Airflow.
  ☆800Updated 2 years ago
• PacktPublishing / Data-Engineering-with-AWS
  Data Engineering with AWS, Published by Packt
  ☆311Updated last year
• jamesdensmore / datapipelinesbook
  ☆170Updated 3 years ago
• coder2j / airflow-docker
  Source code of the Apache Airflow Tutorial for Beginners on YouTube Channel Coder2j (https://www.youtube.com/c/coder2j)
  ☆273Updated 8 months ago
• AlexIoannides / pyspark-example-project
  Implementing best practices for PySpark ETL jobs and applications.
  ☆1,691Updated last year
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆209Updated last year
• Hiflylabs / awesome-dbt
  A curated list of awesome dbt resources
  ☆1,191Updated last month
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆138Updated 4 years ago
• gocardless / airflow-dbt
  Apache Airflow integration for dbt
  ☆396Updated 6 months ago
• nordquant / complete-dbt-bootcamp-zero-to-hero
  Supplementary Materials for the The Complete dbt (Data Build Tool) Bootcamp Udemy course
  ☆458Updated last month
• dbt-labs / jaffle-shop-classic
  A self-contained dbt project for testing purposes
  ☆456Updated 2 months ago
• alanchn31 / Data-Engineering-Projects
  Personal Data Engineering Projects
  ☆858Updated last year
• kevinschaich / pyspark-cheatsheet
  🐍 Quick reference guide to common patterns & functions in PySpark.
  ☆451Updated last year
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆166Updated last year
• RSKriegs / finnhub-streaming-data-pipeline
  Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more
  ☆294Updated 11 months ago
• derar-alhussein / Databricks-Certified-Data-Engineer-Associate
  The resources of the preparation course for Databricks Data Engineer Associate certification exam
  ☆280Updated 3 months ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆113Updated last month
• ovimihai / airflow-cert-dag-authoring
  Course notes for the Astronomer Certification DAG Authoring for Apache Airflow
  ☆51Updated 7 months ago