In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related information using API and transform it into star schema and load to postgresql then analyzed it over PowerBI . Deployment repo link:
☆12Sep 9, 2023Updated 2 years ago
Alternatives and similar repositories for dataengineering-github-data-pipelineline
Users that are interested in dataengineering-github-data-pipelineline are comparing it to the libraries listed below
Sorting:
- This repository contains code and resources for abstractive text summarization (TS) using a novel framework that leverages knowledge-base…☆14Sep 29, 2023Updated 2 years ago
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆24Jul 14, 2022Updated 3 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 2 years ago
- Portfolio of projects and studies conducted in data engineering.☆34Feb 22, 2025Updated last year
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 2 years ago
- This is a real-life, high throughput streaming ELT data pipeline for ecommerce☆15May 22, 2023Updated 2 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- ☆17May 26, 2023Updated 2 years ago
- Business challenge that requires building a data platform for retailer data analytics.☆17Feb 19, 2023Updated 3 years ago
- Run an open-source data LakeHouse locally using Docker Compose☆12May 31, 2024Updated last year
- Courses and projects on Data Camp☆11Jun 28, 2020Updated 5 years ago
- Data Pipeline that utilizes GCP, Python 3.10, Prefect, and more.☆10Jan 23, 2023Updated 3 years ago
- Capstone Project for the IBM Data Engineering Professional Certification.☆13Mar 7, 2022Updated 3 years ago
- Sample Project to Learn Data Engineering☆10Aug 1, 2021Updated 4 years ago
- An experimental attempt to make a CLI for supply-chain modeling for Helpful Engineering's Project Data☆10Oct 29, 2023Updated 2 years ago
- Files for the Docker and Kubernetes on Google Cloud Hands-On labs☆11Mar 14, 2023Updated 2 years ago
- ☆12Jun 18, 2024Updated last year
- This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.☆17Feb 19, 2023Updated 3 years ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated last year
- Collection of LeetCode questions to ace the coding interview!☆15Feb 15, 2026Updated last week
- Short Range Ultrasonic Radar - A simple radar using the ultrasonic sensor, this radar works by measuring a range from 3cm to 40 cm as non…☆19Nov 11, 2024Updated last year
- Advanced TradingView like watchlists for Zerodha Kite☆12Dec 26, 2025Updated 2 months ago
- A PowerBI dashboard to analyze raw sales data from a multinational pharmaceutical manufacturing company and get insights into the perform…☆14Aug 30, 2023Updated 2 years ago
- Modern Data Engineering Project☆12Jun 3, 2022Updated 3 years ago
- This is the final project that after participated the Data Engineering Zoomcamp☆11Apr 4, 2022Updated 3 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Jun 26, 2023Updated 2 years ago
- ☆13Dec 30, 2022Updated 3 years ago
- Airflow & DBT Cloud Integrated Project Presented at Lagos DBT Community Meetup & DataFestAfrica 23☆13Oct 11, 2023Updated 2 years ago
- Apache Spark using SQL☆14Aug 18, 2021Updated 4 years ago
- Spark Structured Streaming data pipeline that processes movie ratings data in real-time.☆13Feb 11, 2026Updated 2 weeks ago
- NoSQL extract, transform, load (ETL) toolkit with Python☆15Feb 17, 2026Updated last week
- KnetBuilder data integration platform for building knowledge graphs. Previously known as ondex.☆15Aug 27, 2025Updated 6 months ago
- Build a Content-Based Movie Recommender System (TF-IDF, BM25, BERT)☆13Jun 13, 2022Updated 3 years ago
- Project based learning for Data Engineering fundamentals.☆13Jan 15, 2021Updated 5 years ago
- A mental health chatbot built using NLP techniques that provides responses from verified psychologists.☆52Nov 26, 2020Updated 5 years ago
- My awesome README.md☆12Sep 18, 2022Updated 3 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆11May 7, 2023Updated 2 years ago
- Code Repository for my 3rd Data Project.☆16Jun 13, 2023Updated 2 years ago