Alternatives and similar repositories for Pyspark_Weather_ETL:

Users that are interested in Pyspark_Weather_ETL are comparing it to the libraries listed below

• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• ktnsh24 / DataModelling
  This repo will guide you step-by-step method to create star schema dimensional model.
  ☆24Updated 3 years ago
• ilya-galperin / SF-EvictionTracker
  Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.
  ☆139Updated 4 years ago
• ajupton / big-data-engineering-project
  Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR
  ☆80Updated 5 years ago
• kislerdm / data-engineering-interviews
  Data engineering interviews Q&A for data community by data community
  ☆62Updated 4 years ago
• aravindr18 / RedditR--Insight-Data-Engineering-Project
  RedditR for Content Engagement and Recommendation
  ☆21Updated 6 years ago
• supratim94336 / DataEngineeringCapstoneProject
  😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS
  ☆43Updated 5 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆113Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆104Updated last year
• iam-mhaseeb / Skytrax-Data-Warehouse
  A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …
  ☆132Updated 4 years ago
• arverma / TowardsDataEngineering
  This repo contains commands that data engineers use in day to day work.
  ☆59Updated last year
• sankamuk / PysparkCheatsheet
  PySpark Cheatsheet
  ☆35Updated last year
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆86Updated 3 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• Amaguk2023 / Pyspark_Spotify_ETL
  Pyspark Spotify ETL
  ☆17Updated 3 years ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 5 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆75Updated 5 years ago
• alanchn31 / Movalytics-Data-Warehouse
  Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow
  ☆133Updated 4 years ago
• HoracioSoldman / batch-processing-on-aws
  With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset wh…
  ☆12Updated 2 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 5 years ago
• jeremyholtzman / jrtests-learn-dbt
  ☆57Updated 3 years ago
• Saurav3218 / Pyspark_Questions_SKS
  This repo is mostly created for pyspark and hive related interview questions.
  ☆46Updated 2 years ago
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆72Updated last year
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆42Updated 4 months ago
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆92Updated last year
• josephwibowo / MeetBaeArea
  Airflow ETL for Meetup API
  ☆46Updated 5 years ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆71Updated 6 months ago
• manuel-lang / Data-Engineering-Nanodegree
  Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,…
  ☆56Updated 2 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆99Updated 4 years ago