themispap / weather_air_quality_etl_piplineLinks
An ETL pipeline that extracts weather and air quality data from public APIs, transforms the data into a clean, analyzable format, and loads it into a PostgreSQL database.
☆30Updated last year
Alternatives and similar repositories for weather_air_quality_etl_pipline
Users that are interested in weather_air_quality_etl_pipline are comparing it to the libraries listed below
Sorting:
- tokyo-olympic-azure-data-engineering-project☆218Updated last year
- This repo contains all the code used in the Python for Data Engineering Course☆323Updated last year
- ☆84Updated 11 months ago
- ☆299Updated last year
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆132Updated 3 years ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆210Updated 2 years ago
- Azure Data Factory☆71Updated 4 months ago
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆136Updated 10 months ago
- Learn PySpark from Basics to Advanced. Checkout the YouTube Series : [PySpark - Zero to Hero]☆111Updated 3 months ago
- Data Engineering Project with Hadoop HDFS and Kafka☆117Updated 2 years ago
- Complete SQL Project for data analysis with source code.☆368Updated 3 years ago
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆97Updated 8 years ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆168Updated 2 years ago
- ☆22Updated 4 years ago
- A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.☆452Updated 7 months ago
- sql-for-data-engineering-course☆18Updated 2 years ago
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆18Updated 2 years ago
- apache-spark-with-databricks-for-data-engineering☆92Updated last year
- ☆114Updated 2 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆208Updated last year
- ☆210Updated 2 years ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Updated 2 years ago
- ☆19Updated last year
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆162Updated 3 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25Updated 2 years ago
- Git Repository☆148Updated 2 months ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆108Updated 3 years ago
- ☆23Updated 2 years ago
- This is an all-in-one repository for Data Engineers, ideal for beginners & interview preparation, which includes Python as the main Progr…☆30Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆28Updated 2 years ago