Alternatives and similar repositories for Pyspark_Weather_ETL

Users that are interested in Pyspark_Weather_ETL are comparing it to the libraries listed below

• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆136Updated 5 years ago
• shravan-kuchkula / udacity-data-eng-proj-1
  Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…
  ☆90Updated 3 years ago
• josephwibowo / MeetBaeArea
  Airflow ETL for Meetup API
  ☆46Updated 6 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• Nunie123 / data_engineering_on_gcp_book
  A book describing how to set up and maintain Data Engineering infrastructure using Google Cloud Platform.
  ☆123Updated 4 years ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆111Updated 2 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆45Updated 5 years ago
• stumelius / howtheydbt
  A curated collection of publicly available resources on dbt best practices and how data-driven organizations around the world utilize dbt
  ☆113Updated 3 years ago
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆140Updated 4 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆77Updated 2 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆168Updated last year
• vivek-bombatkar / Spark-with-Python---My-learning-notes-
  ETL pipeline using pyspark (Spark - Python)
  ☆115Updated 5 years ago
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆162Updated 3 years ago
• astronomer / airflow-dbt-demo
  A repository of sample code to accompany our blog post on Airflow and dbt.
  ☆172Updated last year
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 6 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆116Updated 2 years ago
• PacktPublishing / Snowflake-Cookbook
  Snowflake Cookbook, published by Packt
  ☆79Updated 2 years ago
• Pushkr / Apache-Spark-Hands-On
  Educational notes,Hands on problems w/ solutions for hadoop ecosystem
  ☆87Updated 6 years ago
• bhautikg / InsightHeartbeat
  Insight Project
  ☆9Updated 2 years ago
• Amaguk2023 / Pyspark_Spotify_ETL
  Pyspark Spotify ETL
  ☆17Updated 3 years ago
• igorman / data-engineering
  Challenge for those applying to the Software Engineer, Big Data position
  ☆35Updated 13 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆63Updated 4 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆33Updated 4 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆72Updated 11 months ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆94Updated 10 months ago
• Snowflake-Labs / sfguide-data-engineering-with-snowpark-python
  ☆130Updated 3 months ago
• nareshk1290 / Udacity-Data-Engineering
  Udacity Data Engineering Nano Degree (DEND)
  ☆185Updated 5 years ago
• dbt-labs / redshift
  Redshift package for dbt (getdbt.com)
  ☆102Updated 3 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 7 months ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆86Updated 5 years ago