Alternatives and similar repositories for de02-pyspark-optimization:

Users that are interested in de02-pyspark-optimization are comparing it to the libraries listed below

• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆98Updated 8 months ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆60Updated last year
• ongxuanhong / de03-trino-dbt-spark-everything-everywhere-all-at-once
  ☆15Updated last year
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆50Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆151Updated 8 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆69Updated 2 weeks ago
• delta-io / delta-examples
  Delta Lake examples
  ☆217Updated 4 months ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• mrn-aglic / spark-standalone-cluster
  This repo contains a spark standalone cluster on docker for anyone who wants to play with PySpark by submitting their applications.
  ☆30Updated last year
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆126Updated 7 months ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆43Updated 6 months ago
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆67Updated last month
• delta-io / delta-docs
  Delta Lake Documentation
  ☆48Updated 8 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆43Updated last year
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆179Updated 11 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• developer-advocacy-dremio / quick-guides-from-dremio
  Quick Guides from Dremio on Several topics
  ☆67Updated last month
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆173Updated this week
• PacktPublishing / Data-Engineering-with-Apache-Spark-Delta-Lake-and-Lakehouse
  Data Engineering with Spark and Delta Lake
  ☆95Updated 2 years ago
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆114Updated 2 years ago
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆72Updated 3 years ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆32Updated 4 years ago
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 4 years ago
• leehuwuj / olh
  Open source stack lakehouse
  ☆25Updated 11 months ago
• newfront / spark-moderndataengineering
  The source code for the book Modern Data Engineering with Apache Spark
  ☆35Updated 2 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• LearningJournal / Apache-Spark-and-Databricks-Stream-Processing-in-Lakehouse
  ☆44Updated last year
• raashidsalih / churn-pipeline
  A custom end-to-end analytics platform for customer churn
  ☆10Updated 3 weeks ago
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆141Updated last month