Alternatives and similar repositories for Data_Pipelines_with_Apache_Airflow

Users that are interested in Data_Pipelines_with_Apache_Airflow are comparing it to the libraries listed below

• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆92Updated 6 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆152Updated 5 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆62Updated 2 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆197Updated last year
• itversity / data-engineering-spark
  ☆88Updated 2 years ago
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆139Updated 5 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 2 years ago
• ktnsh24 / DataModelling
  This repo will guide you step-by-step method to create star schema dimensional model.
  ☆25Updated 4 years ago
• PacktPublishing / Data-Engineering-with-AWS
  Data Engineering with AWS, Published by Packt
  ☆329Updated 2 years ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆336Updated 3 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆103Updated last year
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆274Updated last year
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆138Updated 5 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆86Updated 6 years ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆261Updated 2 years ago
• ovimihai / airflow-cert-dag-authoring
  Course notes for the Astronomer Certification DAG Authoring for Apache Airflow
  ☆53Updated last year
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆57Updated 2 years ago
• josephmachado / beginner_de_project
  Beginner data engineering project - batch edition
  ☆537Updated 7 months ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆159Updated 2 months ago
• jamesdensmore / datapipelinesbook
  ☆187Updated 4 years ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆139Updated 6 months ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 4 years ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆64Updated 7 months ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆114Updated 2 years ago
• shravan-kuchkula / udacity-data-eng-proj2
  A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…
  ☆24Updated 3 years ago
• LearningJournal / Spark-Streaming-In-Python
  Apache Spark 3 - Structured Streaming Course Material
  ☆122Updated 2 years ago
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 8 months ago
• uhussain / WebCrawlerForInflation
  Price Crawler - Tracking Price Inflation
  ☆186Updated 5 years ago
• akashmehta10 / profiling_pyspark
  ☆26Updated 2 years ago