newfront / spark-moderndataengineeringLinks
The source code for the book Modern Data Engineering with Apache Spark
☆39Updated 3 years ago
Alternatives and similar repositories for spark-moderndataengineering
Users that are interested in spark-moderndataengineering are comparing it to the libraries listed below
Sorting:
- ☆60Updated last year
- Delta Lake examples☆238Updated last year
- Data Engineering with Spark and Delta Lake☆106Updated 3 years ago
- Don't Panic. This guide will help you when it feels like the end of the world.☆30Updated this week
- Spark style guide☆271Updated last year
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆228Updated 2 years ago
- Data engineering with dbt, published by Packt☆89Updated 5 months ago
- The official repository for the Rock the JVM Spark Optimization with Scala course☆58Updated 2 years ago
- The official repository for the Rock the JVM Spark Optimization 2 course☆42Updated 2 years ago
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆36Updated last year
- Spark and Delta Lake Workshop☆22Updated 3 years ago
- Delta Lake Documentation☆53Updated last year
- Playing with different packages of the Apache Spark☆30Updated this week
- Companion repository for the book 'Delta Lake Up and Running'☆48Updated 10 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆197Updated this week
- Snowflake Cookbook, published by Packt☆83Updated 3 years ago
- Repository of sample Databricks notebooks☆277Updated last year
- Code snippets used in demos recorded for the blog.☆37Updated 3 weeks ago
- Guide for databricks spark certification☆59Updated 4 years ago
- Apache Spark 3 - Structured Streaming Course Material☆126Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆331Updated last month
- ☆110Updated last year
- Delta Lake helper methods in PySpark☆327Updated 3 weeks ago
- This repo contains live examples to build Databricks' Lakehouse and recommended best practices from the field.☆22Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56Updated 2 years ago
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆78Updated 9 months ago
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆18Updated 3 years ago
- ☆16Updated 6 years ago
- Demo of using the Nutter for testing of Databricks notebooks in the CI/CD pipeline☆151Updated last year
- Code samples, etc. for Databricks☆73Updated 8 months ago