GrzegorzGatkowski / Air_Pollution_Pipeline
Data Engineering Project in GCP
☆18Updated last year
Alternatives and similar repositories for Air_Pollution_Pipeline:
Users that are interested in Air_Pollution_Pipeline are comparing it to the libraries listed below
- ☆28Updated last year
- DataTalks.Club's Data Engineering Zoomcamp Project☆22Updated 2 years ago
- Final Project of the MLOps Zoomcamp hosted by DataTalksClub.☆26Updated 2 years ago
- Data Pipeline from the Global Historical Climatology Network DataSet☆26Updated 2 years ago
- End to end data engineering project☆53Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆24Updated last year
- ☆19Updated last year
- This is the final project that after participated the Data Engineering Zoomcamp☆10Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- ☆32Updated last year
- ☆41Updated last year
- Simple ETL pipeline using Python☆25Updated last year
- Near real time ETL to populate a dashboard.☆73Updated 8 months ago
- ML Zoomcamp fall 2021 homework and stuff☆63Updated 3 years ago
- ☆32Updated 2 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆22Updated 2 years ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆34Updated last year
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆107Updated 2 years ago
- A project portfolio to accompany my resume☆26Updated last year
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆21Updated 2 years ago
- Sample project to demonstrate data engineering best practices☆177Updated 11 months ago
- Data Engineering Project to Extract and Process Solana Reddit Data☆26Updated last year
- Data pipeline for uploading, preprocessing, and visualising COVID19 data☆18Updated last year
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Updated 2 years ago
- Earthquakes API Live Data Project - Data Engineering Zoomcamp Project☆13Updated last year
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆16Updated 2 years ago
- ☆87Updated 2 years ago
- Django-based course management platform for Zoomcamps☆61Updated this week
- This repo contains commands that data engineers use in day to day work.☆60Updated 2 years ago
- Awesome list of resources for analytics engineers☆25Updated 3 years ago