paypay / DataEngineerChallengeLinks
☆23Updated 3 years ago
Alternatives and similar repositories for DataEngineerChallenge
Users that are interested in DataEngineerChallenge are comparing it to the libraries listed below
Sorting:
- Repository used for Spark Trainings☆54Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆151Updated 5 months ago
- Code snippets used in demos recorded for the blog.☆38Updated 2 weeks ago
- Magic to help Spark pipelines upgrade☆34Updated 11 months ago
- ☆23Updated 2 years ago
- A Python PySpark Projet with Poetry☆23Updated last month
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Spark Examples☆125Updated 3 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- The official repository for the Rock the JVM Spark Optimization 2 course☆40Updated last year
- The official repository for the Rock the JVM Spark Optimization with Scala course☆58Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆88Updated 4 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆64Updated 3 years ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆221Updated 2 years ago
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆18Updated 3 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Weekly Data Engineering Newsletter☆96Updated last year
- The official repository for the Rock the JVM Spark Essentials with Scala course☆273Updated 6 months ago
- Spark style guide☆262Updated 11 months ago
- The source code for the book Modern Data Engineering with Apache Spark☆37Updated 3 years ago
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 4 years ago
- Because its never late to start taking notes and 'public' it...☆61Updated 3 months ago
- Airflow Unit Tests and Integration Tests☆260Updated 2 years ago
- A Python Library to support running data quality rules while the spark job is running⚡☆189Updated last week
- Delta lake and filesystem helper methods☆51Updated last year
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆406Updated last week
- For Udemy students: the official repository of Rock the JVM's Spark Streaming course☆26Updated 2 years ago
- Filling in the Spark function gaps across APIs☆50Updated 4 years ago
- PySpark data-pipeline testing and CICD☆28Updated 4 years ago
- Delta Lake examples☆227Updated 10 months ago