leehuwuj / olh

Related projects ⓘ

Alternatives and complementary repositories for olh

• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated 9 months ago
• hussein-awala / spark-on-k8s
  A Python package to submit and manage Apache Spark applications on Kubernetes.
  ☆35Updated last week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆62Updated last month
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆70Updated 3 years ago
• raashidsalih / churn-pipeline
  A custom end-to-end data pipeline for customer churn
  ☆9Updated 3 weeks ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆40Updated last week
• ongxuanhong / de02-pyspark-optimization
  ☆13Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆163Updated last week
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆46Updated 8 months ago
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆44Updated last year
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆111Updated this week
• tj--- / iceberg-demo
  A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
  ☆16Updated 2 years ago
• naushadh / hive-metastore
  Apache Hive Metastore as a Standalone server in Docker
  ☆67Updated 3 months ago
• Wuerike / kafka-iceberg-streaming
  Docker envinroment to stream data from Kafka to Iceberg tables
  ☆24Updated 8 months ago
• trannhatnguyen2 / NYC_Taxi_Data_Pipeline
  Nyc_Taxi_Data_Pipeline - DE Project
  ☆85Updated last month
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆189Updated this week
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆18Updated last year
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆30Updated 3 weeks ago
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆49Updated 8 months ago
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆22Updated 2 months ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆61Updated 2 years ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆57Updated last year
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆21Updated 5 months ago
• ysfesr / Building-Data-LakeHouse
  Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
  ☆40Updated 11 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆84Updated 8 months ago
• delta-io / delta-examples
  Delta Lake examples
  ☆208Updated last month
• borjavb / dbt-iceberg-poc
  ☆66Updated last month
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆44Updated 2 years ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆28Updated 8 months ago