faizeraza / dataengineering-github-data-pipelineline
In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related information using API and transform it into star schema and load to postgresql then analyzed it over PowerBI . Deployment repo link:
☆11Updated last year
Related projects ⓘ
Alternatives and complementary repositories for dataengineering-github-data-pipelineline
- This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.☆13Updated last year
- Data Engineering Project in GCP☆19Updated last year
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆22Updated last year
- ☆27Updated 11 months ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆21Updated last year
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆16Updated 2 years ago
- ☆18Updated 10 months ago
- Business challenge that requires building a data platform for retailer data analytics.☆12Updated last year
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆14Updated 3 years ago
- Airflow & DBT Cloud Integrated Project Presented at Lagos DBT Community Meetup & DataFestAfrica 23☆13Updated last year
- DataTalks.Club's Data Engineering Zoomcamp Project☆22Updated 2 years ago
- A project portfolio to accompany my resume☆22Updated last year
- Data Engineering Project to Extract and Process Solana Reddit Data☆22Updated 9 months ago
- End-to-end ELT data engineering project☆20Updated last year
- ☆16Updated last year
- Simple ETL pipeline using Python☆20Updated last year
- Projects of the Udacity Data Engineering Nanodegree Program.☆9Updated 2 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆11Updated last year
- Repository containing example solutions for the Data Engineering Career Path Portfolio Projects☆10Updated 2 years ago
- This repo will guide you step-by-step method to create star schema dimensional model.☆24Updated 3 years ago
- Code Repository for my 3rd Data Project.☆12Updated last year
- ☆14Updated last year
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆22Updated 2 years ago
- ☆11Updated last year
- Data Pipeline from the Global Historical Climatology Network DataSet☆24Updated last year
- Code Repository for my 1st Data Project.☆21Updated last year
- My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform☆14Updated 2 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆8Updated 3 years ago
- Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3☆25Updated 3 years ago
- ☆42Updated 3 years ago