Alternatives and similar repositories for cdc_pyspark_hive:

Users that are interested in cdc_pyspark_hive are comparing it to the libraries listed below

• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆47Updated 2 years ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆100Updated 10 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆221Updated 6 months ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆54Updated last year
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆28Updated 4 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated 10 months ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 9 months ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 6 years ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆78Updated 3 weeks ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆28Updated 4 years ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆64Updated last year
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 4 years ago
• josephmachado / online_store
  End to end data engineering project
  ☆54Updated 2 years ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆45Updated 8 months ago
• borjavb / dbt-iceberg-poc
  ☆76Updated 6 months ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆33Updated 4 years ago
• jaceklaskowski / spark-delta-lake-workshop
  Spark and Delta Lake Workshop
  ☆22Updated 2 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆56Updated 8 months ago
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…
  ☆18Updated 7 months ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆66Updated 2 years ago
• itversity / data-engineering-spark
  ☆87Updated 2 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆181Updated this week
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆174Updated 3 years ago
• ssp-data / data-engineering-devops
  Full stack data engineering tools and infrastructure set-up
  ☆51Updated 4 years ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆109Updated 2 years ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆322Updated 7 months ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• datakickstart / databricks-notebooks
  ☆10Updated 2 years ago