DeepHiveMind / Distributed_DataMesh_2.0_Cloud_Implementation
Distributed Data Mesh 2.0 | DataMesh-as-a-Code on Cloud | Theory to Industrialization
☆35Updated 2 years ago
Alternatives and similar repositories for Distributed_DataMesh_2.0_Cloud_Implementation:
Users that are interested in Distributed_DataMesh_2.0_Cloud_Implementation are comparing it to the libraries listed below
- Example project using DBT, Databricks and AdventureWorks sample database☆11Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆50Updated 4 years ago
- This repository contains recipes for Apache Pinot.☆30Updated last month
- A Table format agnostic data sharing framework☆38Updated last year
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆134Updated 2 months ago
- ☆96Updated last year
- Docker envinroment to stream data from Kafka to Iceberg tables☆26Updated last year
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated 2 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆28Updated last week
- New generation opensource data stack☆65Updated 2 years ago
- ☆13Updated last year
- Playground site for creating/validating data contracts☆9Updated 6 months ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 4 years ago
- Code snippets for Data Engineering Design Patterns book☆75Updated last week
- Sample code to collect Apache Iceberg metrics for table monitoring☆25Updated 7 months ago
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- Yet Another (Spark) ETL Framework☆20Updated last year
- DataHub on AWS demonstration resources☆10Updated 2 years ago
- ☆19Updated 3 weeks ago
- ☆15Updated last year
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- Utility functions for dbt projects running on Spark☆31Updated last month
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Witboost is a versatile platform that addresses a wide range of sophisticated data engineering challenges. The Starter Kit showcases the …☆21Updated this week
- Delta Lake Documentation☆49Updated 9 months ago
- NiFi Processor for Apache Pulsar☆10Updated 4 months ago
- lakefs-samples repository☆79Updated this week
- ☆10Updated 2 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆67Updated 10 months ago