newfront / spark-moderndataengineering
The source code for the book Modern Data Engineering with Apache Spark
☆36Updated 2 years ago
Alternatives and similar repositories for spark-moderndataengineering:
Users that are interested in spark-moderndataengineering are comparing it to the libraries listed below
- ☆14Updated 6 years ago
- Data Engineering with Spark and Delta Lake☆98Updated 2 years ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆57Updated last year
- Code snippets used in demos recorded for the blog.☆35Updated last week
- Code snippets for Data Engineering Design Patterns book☆101Updated last month
- Data engineering with dbt, published by Packt☆77Updated last year
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆19Updated 2 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆54Updated 2 years ago
- Spark and Delta Lake Workshop☆22Updated 2 years ago
- The official repository for the Rock the JVM Spark Optimization 2 course☆39Updated last year
- ☆25Updated last year
- ☆80Updated 3 months ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 5 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆186Updated this week
- Spark style guide☆258Updated 7 months ago
- Repository used for Spark Trainings☆53Updated 2 years ago
- My Study guide used to pass the CRT020 Spark Certification exam☆33Updated 5 years ago
- Delta Lake examples☆225Updated 6 months ago
- Guide for databricks spark certification☆58Updated 3 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆38Updated 9 months ago
- ETL pipeline using pyspark (Spark - Python)☆114Updated 5 years ago
- Data Engineering on GCP☆35Updated 2 years ago
- The resources of the preparation course for Databricks Data Engineer Professional certification exam☆113Updated 3 weeks ago
- ☆87Updated 2 years ago
- Custom PySpark Data Sources☆50Updated this week
- ☆36Updated 3 months ago
- This repo contains live examples to build Databricks' Lakehouse and recommended best practices from the field.☆18Updated 6 months ago
- Source Code Collection and Supplemental Material for the O'Reilly Snowflake Definitive Guide 1st Edition book☆94Updated 2 years ago
- Magic to help Spark pipelines upgrade☆34Updated 7 months ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆214Updated last year