Alternatives and similar repositories for Data_Pipelines_with_Apache_Airflow

Users that are interested in Data_Pipelines_with_Apache_Airflow are comparing it to the libraries listed below

• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆257Updated last year
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆140Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆86Updated 5 years ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 6 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆144Updated 4 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆122Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆111Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆66Updated 3 months ago
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆79Updated 2 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆106Updated last month
• TopperTips / Snowflake-By-Example
  All the Snowflake Virtual Warehouse - Example
  ☆12Updated 4 years ago
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆98Updated 2 years ago
• cristiscu / programming-in-snowflake
  All demo code for the Udemy course "Programming in Snowflake".
  ☆21Updated 11 months ago
• dgadiraju / retail_db
  ☆53Updated 4 years ago
• jeremyholtzman / jrtests-learn-dbt
  ☆61Updated 3 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆191Updated last year
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆115Updated 5 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆56Updated 9 months ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆130Updated 3 months ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 5 years ago
• PacktPublishing / Data-Modeling-with-Snowflake
  Data Modeling with Snowflake, published by Packt
  ☆65Updated last month
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆102Updated 11 months ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆176Updated 3 years ago
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆36Updated 2 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆224Updated 7 months ago