airscholar / FootballDataEngineeringLinks
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
☆26Updated 2 years ago
Alternatives and similar repositories for FootballDataEngineering
Users that are interested in FootballDataEngineering are comparing it to the libraries listed below
Sorting:
- apache-spark-with-databricks-for-data-engineering☆90Updated last year
- Data Engineering YouTube Analysis Project by Darshil Parmar☆206Updated last year
- This repo contains all the code used in the Python for Data Engineering Course☆320Updated last year
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆157Updated last year
- ☆291Updated last year
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆131Updated 2 years ago
- Data Engineering with Python, published by Packt☆741Updated 2 years ago
- ☆369Updated 8 months ago
- tokyo-olympic-azure-data-engineering-project☆215Updated last year
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆108Updated 3 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆194Updated last year
- This is a template you can use for your next data engineering portfolio project.☆182Updated 4 years ago
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆132Updated 8 months ago
- Personal Data Engineering Projects☆950Updated 2 years ago
- ☆156Updated 3 years ago
- ☆142Updated 2 years ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆164Updated 2 years ago
- The resources of the preparation course for Databricks Data Engineer Associate certification exam☆495Updated 3 weeks ago
- Data Engineering Project with Hadoop HDFS and Kafka☆118Updated last year
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆360Updated last year
- YouTube tutorial project☆105Updated last year
- Ultimate guide for mastering Spark Performance Tuning and Optimization concepts and for preparing for Data Engineering interviews☆167Updated last month
- ☆22Updated 4 years ago
- A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!☆754Updated 3 years ago
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆240Updated 2 years ago
- Azure Data Factory☆66Updated 2 months ago
- ☆79Updated 6 months ago
- ☆87Updated 8 months ago
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆19Updated 2 years ago
- sql-for-data-engineering-course☆19Updated 2 years ago