airscholar / FootballDataEngineering
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
☆23Updated last year
Alternatives and similar repositories for FootballDataEngineering:
Users that are interested in FootballDataEngineering are comparing it to the libraries listed below
- Data Engineering YouTube Analysis Project by Darshil Parmar☆184Updated last year
- tokyo-olympic-azure-data-engineering-project☆195Updated 8 months ago
- sql-for-data-engineering-course☆19Updated last year
- YouTube tutorial project☆102Updated last year
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆102Updated 2 years ago
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆126Updated last year
- Sample repo for startdataengineering DE 101 free course☆55Updated 9 months ago
- ☆151Updated 2 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆130Updated 7 months ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆149Updated 2 years ago
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆72Updated 9 months ago
- ☆22Updated 3 years ago
- Sample project to demonstrate data engineering best practices☆184Updated last year
- This is a template you can use for your next data engineering portfolio project.☆175Updated 3 years ago
- This repo contains all the code used in the Python for Data Engineering Course☆273Updated 11 months ago
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆101Updated 2 months ago
- apache-spark-with-databricks-for-data-engineering☆78Updated 9 months ago
- ☆135Updated 2 years ago
- Cool DE Projects☆25Updated last month
- Data Engineering Project with Hadoop HDFS and Kafka☆91Updated last year
- ☆272Updated 7 months ago
- data-warehouse-snowflake-for-data-engineering☆17Updated last year
- ☆195Updated last year
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆27Updated last year
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆82Updated 7 years ago
- ☆83Updated last year
- Local SQL Database ---> Azure ---> Power BI☆14Updated last year
- Azure Data Factory☆59Updated this week
- ☆21Updated 8 months ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆35Updated last year