Alternatives and similar repositories for cdc_pyspark_hive

Users that are interested in cdc_pyspark_hive are comparing it to the libraries listed below

• delta-io / delta-examples
  Delta Lake examples
  ☆227Updated 10 months ago
• delta-io / delta-docs
  Delta Lake Documentation
  ☆49Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆108Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆151Updated 5 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated last week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆325Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆159Updated 3 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆262Updated 11 months ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆74Updated 2 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆55Updated 2 years ago
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆16Updated 6 years ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 11 months ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• konosp / dbt-airflow-docker-compose
  Execution of DBT models using Apache Airflow through Docker Compose
  ☆118Updated 2 years ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆114Updated 2 years ago
• delta-incubator / delta-lake-definitive-guide
  ☆45Updated 7 months ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆34Updated 4 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆48Updated 2 years ago
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆260Updated last month
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 4 years ago
• Data-Engineering-Weekly / dataengineeringweekly
  Weekly Data Engineering Newsletter
  ☆96Updated last year
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 2 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆57Updated 2 years ago
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆197Updated last year
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆220Updated 4 months ago
• mahmoudparsian / data-algorithms-with-spark
  O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
  ☆221Updated 2 years ago
• garystafford / tickit-data-lake-demo
  Resources for video demonstrations and blog posts related to DataOps on AWS
  ☆182Updated 3 years ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last month
• akashmehta10 / profiling_pyspark
  ☆26Updated 2 years ago
• PacktPublishing / Data-engineering-with-dbt
  Data engineering with dbt, published by Packt
  ☆85Updated last year