airscholar / FootballDataEngineering
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
☆16Updated last year
Related projects ⓘ
Alternatives and complementary repositories for FootballDataEngineering
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆63Updated last year
- sql-for-data-engineering-course☆18Updated last year
- tokyo-olympic-azure-data-engineering-project☆162Updated 4 months ago
- YouTube tutorial project☆94Updated last year
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆204Updated last year
- Azure Data Factory☆48Updated this week
- This repo contains all the code used in the Python for Data Engineering Course☆231Updated 6 months ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆138Updated 11 months ago
- ☆11Updated 4 months ago
- ☆224Updated 3 months ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆23Updated 11 months ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆88Updated 3 months ago
- Git Repository☆131Updated last year
- ☆22Updated 3 years ago
- notes for DP203-Data Engineering on Azure☆50Updated 6 months ago
- Sample repo for startdataengineering DE 101 free course☆35Updated 4 months ago
- Price Crawler - Tracking Price Inflation☆184Updated 4 years ago
- ☆130Updated 2 years ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆99Updated 2 years ago
- ☆128Updated last year
- Azure Data Engineer Associate Certification Guide, published by Packt☆75Updated last year
- Sample project to demonstrate data engineering best practices☆166Updated 8 months ago
- Data Engineering with Google Cloud Platform, published by Packt☆109Updated last year
- Data Engineering with AWS, 2nd edition - Published by Packt☆108Updated last year
- ☆181Updated last year
- ☆45Updated 2 weeks ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆31Updated 11 months ago
- ☆19Updated 7 months ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆133Updated 4 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆22Updated last year