josephmachado / efficient_data_processing_spark
Code for "Efficient Data Processing in Spark" Course
☆212Updated 3 months ago
Related projects: ⓘ
- This repository helps teach people how to correctly define and create cumulative tables!☆209Updated last month
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆225Updated 2 months ago
- Sample project to demonstrate data engineering best practices☆156Updated 6 months ago
- Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake☆67Updated 2 weeks ago
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.☆190Updated last year
- Template for Data Engineering and Data Pipeline projects☆101Updated last year
- This repository goes over how to handle massive variety in data engineering☆83Updated last year
- ☆124Updated 2 years ago
- ☆406Updated 2 months ago
- This is a template you can use for your next data engineering portfolio project.☆151Updated 3 years ago
- Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consu…☆66Updated 9 months ago
- Code for "Advanced data transformations in SQL" free live workshop☆54Updated last month
- ☆123Updated last year
- ☆142Updated 6 months ago
- Code for dbt tutorial☆138Updated 3 months ago
- ☆302Updated 3 weeks ago
- A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.☆191Updated 3 months ago
- ☆94Updated last month
- End to end data engineering project☆49Updated last year
- Stream processing pipeline from Finnhub websocket using Spark, Kafka, Kubernetes and more☆286Updated 9 months ago
- ☆87Updated 2 years ago
- This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksCl…☆94Updated 3 weeks ago
- ☆38Updated this week
- ☆22Updated 5 months ago
- ☆100Updated last month
- Near real time ETL to populate a dashboard.☆69Updated 3 months ago
- Repo for saving cheat sheets☆39Updated 3 months ago
- Sample repo for startdataengineering DE 101 free course☆23Updated 2 months ago
- velib-v2___an ETL pipeline that employs batch and streaming jobs using spark, kafka, airflow, and other tools☆17Updated last week
- Practical Data Engineering: A Hands-On Real-Estate Project Guide☆507Updated 2 weeks ago