airscholar / FootballDataEngineeringLinks
An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.
☆24Updated last year
Alternatives and similar repositories for FootballDataEngineering
Users that are interested in FootballDataEngineering are comparing it to the libraries listed below
Sorting:
- Data Engineering YouTube Analysis Project by Darshil Parmar☆203Updated last year
- This repo contains all the code used in the Python for Data Engineering Course☆310Updated last year
- tokyo-olympic-azure-data-engineering-project☆215Updated last year
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆155Updated last year
- datacamp Data Engineer with Python course. 73 hours/ 19 Courses /2 Skill Assessments☆131Updated 2 years ago
- ☆289Updated last year
- apache-spark-with-databricks-for-data-engineering☆89Updated last year
- Data Engineering with Python, published by Packt☆739Updated 2 years ago
- YouTube tutorial project☆106Updated last year
- This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science t…☆133Updated 8 months ago
- ☆154Updated 3 years ago
- Data Engineering Project with Hadoop HDFS and Kafka☆117Updated last year
- ☆365Updated 7 months ago
- ☆22Updated 3 years ago
- sql-for-data-engineering-course☆19Updated 2 years ago
- Azure Data Factory☆66Updated last month
- Personal Data Engineering Projects☆946Updated 2 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆24Updated 2 years ago
- Projects done in the Data Engineer Nanodegree Program by Udacity.com☆163Updated 2 years ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆108Updated 3 years ago
- This is a template you can use for your next data engineering portfolio project.☆181Updated 4 years ago
- This repo contains "Databricks Certified Data Engineer Associate" Questions and related docs.☆190Updated last year
- Sample repo for startdataengineering DE 101 free course☆69Updated last year
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆239Updated 2 years ago
- For the Coursera specialization https://www.coursera.org/specializations/gcp-data-machine-learning☆97Updated 7 years ago
- ☆203Updated 2 years ago
- ☆142Updated 2 years ago
- Data Engineering with AWS, Published by Packt☆329Updated 2 years ago
- Transform data from on-premises SQL Server to Azure Delta Lake Storage for Analytics and Visualization☆19Updated 2 years ago
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆357Updated last year