newfront / spark-moderndataengineeringLinks
The source code for the book Modern Data Engineering with Apache Spark
☆37Updated 3 years ago
Alternatives and similar repositories for spark-moderndataengineering
Users that are interested in spark-moderndataengineering are comparing it to the libraries listed below
Sorting:
- Delta Lake examples☆227Updated 11 months ago
- Data engineering with dbt, published by Packt☆85Updated 2 weeks ago
- ☆46Updated 7 months ago
- Data Engineering with Spark and Delta Lake☆104Updated 2 years ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆221Updated 2 years ago
- Spark style guide☆263Updated 11 months ago
- Playing with different packages of the Apache Spark☆30Updated this week
- The official repository for the Rock the JVM Spark Optimization 2 course☆40Updated last year
- ☆95Updated 8 months ago
- Delta Lake helper methods in PySpark☆325Updated last year
- Weekly Data Engineering Newsletter☆96Updated last year
- Delta Lake Documentation☆49Updated last year
- Demonstration of using Files in Repos with Databricks Delta Live Tables☆35Updated last year
- Code for my "Efficient Data Processing in SQL" book.☆59Updated last year
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated last week
- Repository of sample Databricks notebooks☆266Updated last year
- Guide for databricks spark certification☆58Updated 4 years ago
- Magic to help Spark pipelines upgrade☆34Updated 11 months ago
- Apache Spark 3 - Structured Streaming Course Material☆123Updated 2 years ago
- Code samples, etc. for Databricks☆68Updated 3 months ago
- Don't Panic. This guide will help you when it feels like the end of the world.☆27Updated 2 weeks ago
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆107Updated 2 months ago
- ☆23Updated 2 years ago
- Custom PySpark Data Sources☆65Updated 3 weeks ago
- Code snippets for Data Engineering Design Patterns book☆182Updated 6 months ago
- Data pipeline with dbt, Airflow, Great Expectations☆163Updated 4 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆75Updated 4 months ago
- Azure Databricks Cookbook, Published by Packt☆58Updated 2 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year