themispap / weather_air_quality_etl_piplineLinks
An ETL pipeline that extracts weather and air quality data from public APIs, transforms the data into a clean, analyzable format, and loads it into a PostgreSQL database.
☆24Updated last year
Alternatives and similar repositories for weather_air_quality_etl_pipline
Users that are interested in weather_air_quality_etl_pipline are comparing it to the libraries listed below
Sorting:
- This repo contains all the code used in the Python for Data Engineering Course☆320Updated last year
- tokyo-olympic-azure-data-engineering-project☆215Updated last year
- Data Engineering Project with Hadoop HDFS and Kafka☆118Updated last year
- Learn PySpark from Basics to Advanced. Checkout the YouTube Series : [PySpark - Zero to Hero]☆90Updated last month
- ☆290Updated last year
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆156Updated last year
- ☆79Updated 9 months ago
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆131Updated 2 years ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆206Updated last year
- ☆22Updated 4 years ago
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆19Updated 2 years ago
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆96Updated 7 years ago
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆132Updated 8 months ago
- A comprehensive guide to building a modern data warehouse with SQL Server, including ETL processes, data modeling, and analytics.☆360Updated 5 months ago
- ☆117Updated 3 years ago
- ☆101Updated 2 years ago
- YouTube tutorial project☆105Updated last year
- Data Engineer with Python lecture notes from #datacamp.☆50Updated 4 years ago
- ☆14Updated 3 years ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆108Updated 3 years ago
- Repository of SQL projects, case studies, platform solutions, and learning resources to enhance SQL skills through practical applications…☆225Updated 5 months ago
- Sample repo for startdataengineering DE 101 free course☆69Updated last year
- ☆107Updated last year
- apache-spark-with-databricks-for-data-engineering☆90Updated last year
- ☆19Updated last year
- ☆44Updated 11 months ago
- This repository include the Roadmap for AWS Data Engineering☆41Updated last month
- Azure Data Factory☆66Updated 2 months ago
- End-to-end ETL pipeline in the Microsoft Azure cloud - (Jun '24 - Jul '24)☆22Updated last year
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆24Updated 2 years ago