akashmehta10 / cdc_pyspark_hive

Related projects: ⓘ

• delta-io / delta-docs
  Delta Lake Documentation
  ☆45Updated 3 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆201Updated 3 months ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆47Updated last month
• raashidsalih / churn-pipeline
  A custom end-to-end data pipeline for customer churn
  ☆9Updated this week
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆41Updated 2 months ago
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆89Updated 3 months ago
• josephmachado / spark_submit_airflow
  Simple repo to demonstrate how to submit a spark job to EMR from Airflow
  ☆31Updated 3 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆42Updated last year
• josephmachado / online_store
  End to end data engineering project
  ☆49Updated last year
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆27Updated 3 years ago
• akashmehta10 / profiling_pyspark
  ☆25Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆161Updated last month
• datamechanics / examples
  ☆38Updated this week
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆100Updated 2 months ago
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated 10 months ago
• mehd-io / pyspark-boilerplate-mehdio
  Pyspark boilerplate for running prod ready data pipeline
  ☆29Updated 3 years ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆48Updated 6 months ago
• developer-advocacy-dremio / quick-guides-from-dremio
  Quick Guides from Dremio on Several topics
  ☆60Updated 2 weeks ago
• cordon-thiago / spark-schema-merge
  Spark app to merge different schemas
  ☆23Updated 3 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• NAVEENKUMARMURUGAN / Pyspark-ETL-Framework
  ☆14Updated 5 years ago
• databricks-academy / dbacademy
  Internal library used to develop and test Databricks Academy courseware
  ☆66Updated 4 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆27Updated this week
• databrickslabs / discoverx
  A Swiss-Army-knife for your Data Intelligence platform administration.
  ☆104Updated last month
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆300Updated 2 weeks ago
• marclamberti / webinar-airflow-chart
  Materials of the Official Helm Chart Webinar
  ☆26Updated 3 years ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆51Updated last year
• szymonzaczek / databricks-ci-cd
  Databricks CI/CD using Azure DevOps
  ☆20Updated last year
• databricks / dbt-databricks
  A dbt adapter for Databricks.
  ☆211Updated this week
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆54Updated last year