newfront / spark-moderndataengineeringLinks
The source code for the book Modern Data Engineering with Apache Spark
☆39Updated 3 years ago
Alternatives and similar repositories for spark-moderndataengineering
Users that are interested in spark-moderndataengineering are comparing it to the libraries listed below
Sorting:
- ☆58Updated 11 months ago
- Data Engineering with Spark and Delta Lake☆106Updated 2 years ago
- Delta Lake examples☆236Updated last year
- Don't Panic. This guide will help you when it feels like the end of the world.☆30Updated 4 months ago
- Data engineering with dbt, published by Packt☆90Updated 4 months ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆227Updated 2 years ago
- ☆107Updated 11 months ago
- Spark style guide☆271Updated last year
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆36Updated last year
- Companion repository for the book 'Delta Lake Up and Running'☆48Updated 9 months ago
- Code snippets for Data Engineering Design Patterns book☆307Updated last week
- Delta Lake Documentation☆52Updated last year
- Repository of sample Databricks notebooks☆274Updated last year
- The official repository for the Rock the JVM Spark Optimization 2 course☆42Updated 2 years ago
- Apache Spark 3 - Structured Streaming Course Material☆125Updated 2 years ago
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆78Updated 8 months ago
- Snowflake Cookbook, published by Packt☆82Updated 2 years ago
- Delta Lake helper methods in PySpark☆326Updated last year
- Spark and Delta Lake Workshop☆22Updated 3 years ago
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆126Updated 2 months ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆183Updated 2 years ago
- Code repository for the "PySpark in Action" book☆211Updated 7 months ago
- Code snippets used in demos recorded for the blog.☆37Updated last month
- Playing with different packages of the Apache Spark☆30Updated 2 weeks ago
- A Python Library to support running data quality rules while the spark job is running⚡☆193Updated 2 weeks ago
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆18Updated 3 years ago
- Guide for databricks spark certification☆59Updated 4 years ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆58Updated 2 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- ☆191Updated 4 years ago