JacekMajchrzak / awesome-datamesh

Related projects: ⓘ

• agile-lab-dev / Data-Product-Specification
  An open specification for data products in Data Mesh
  ☆53Updated 9 months ago
• TrivadisPF / platys-modern-data-platform
  Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
  ☆68Updated this week
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆60Updated last year
• mahdiqb / modern_data_platform
  Sample configuration to deploy a modern data platform.
  ☆84Updated 2 years ago
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆91Updated this week
• data-mill-cloud / data-mill
  A K8s-based infrastructure for analytics
  ☆24Updated 4 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• mikulskibartosz / check-engine
  Data validation library for PySpark 3.0.0
  ☆34Updated last year
• developer-advocacy-dremio / definitive-guide-to-apache-iceberg
  ☆37Updated 6 months ago
• datacontract / datacontract-specification
  The Data Contract Specification Repository
  ☆231Updated this week
• astronomer / airflow-testing-guide
  ☆20Updated 3 years ago
• datamesh-architecture / datamesh-architecture.com
  Data Mesh Architecture
  ☆70Updated 2 months ago
• victorcouste / data-tools
  Data Tools Subjective List
  ☆80Updated last year
• astronomer / airflow-example-dags
  Sample Airflow DAGs
  ☆60Updated last year
• confluentinc / data-mesh-demo
  A Data Mesh proof-of-concept built on Confluent Cloud
  ☆2Updated last year
• victorcouste / trino-dbt-demo
  Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database
  ☆64Updated 3 years ago
• greatexpectationslabs / ge_tutorials
  Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.
  ☆167Updated 10 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆36Updated 7 months ago
• AltimateAI / awesome-data-contracts
  A curated list of awesome blogs, videos, tools and resources about Data Contracts
  ☆158Updated last month
• delta-io / delta-docs
  Delta Lake Documentation
  ☆45Updated 3 months ago
• databrickslabs / dataframe-rules-engine
  Extensible Rules Engine for custom Dataframe / Dataset validation
  ☆134Updated 4 months ago
• opendatamesh-initiative / odm-specification-dpdescriptor
  The Data Product Descriptor Specification (DPDS) Repository
  ☆66Updated this week
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆89Updated 3 years ago
• MaterializeInc / datagen
  Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.
  ☆141Updated 2 weeks ago
• PacktPublishing / Driving-Data-Quality-with-Data-Contracts
  ☆32Updated 3 months ago
• conveyordata / data-product-portal
  Data product portal created by Dataminded
  ☆123Updated this week
• danielvdende / data-testing-with-airflow
  ☆195Updated 11 months ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆28Updated 2 weeks ago
• garystafford / streaming-sales-generator
  Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python
  ☆43Updated last year
• dbt-labs / dbt-learn-group-training
  The go to demo for public and private dbt Learn
  ☆70Updated 2 weeks ago