TrivadisPF / data-mesh-hackathonLinks
A Data Mesh demo repository
☆13Updated last year
Alternatives and similar repositories for data-mesh-hackathon
Users that are interested in data-mesh-hackathon are comparing it to the libraries listed below
Sorting:
- ☆100Updated 2 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆80Updated this week
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 4 months ago
- A plugin for Apache Airflow that allows you to manage the users that can login☆14Updated 6 years ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆355Updated 2 weeks ago
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆127Updated 4 years ago
- ☆21Updated 5 months ago
- Demos of Materialize, the operational data warehouse.☆52Updated 11 months ago
- Lightweight configuration and access to multiple databases in a single project☆38Updated 2 years ago
- Read Delta tables without any Spark☆47Updated last year
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆62Updated 3 years ago
- A plugin for Airflow that create and manage your DAG with web UI.☆20Updated 8 years ago
- A simple Spark-powered ETL framework that just works 🍺☆183Updated 4 months ago
- The sane way of building a data layer in Airflow☆24Updated 6 years ago
- Data Catalog for Databases and Data Warehouses☆36Updated 2 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated last week
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆81Updated 2 weeks ago
- ☆80Updated 3 years ago
- The DataHelix generator allows you to quickly create data, based on a JSON profile that defines fields and the relationships between them…☆143Updated 2 years ago
- Minimal example to run Trino, Minio, and Hive standalone metastore on docker☆54Updated 3 years ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated last week
- Official repo for the Materialize + Redpanda + dbt Hack Day 2022, including a sample project to get everyone started!☆60Updated 3 years ago
- Weekly Data Engineering Newsletter☆96Updated last year
- Dremio Flight connector. Access Dremio using Arrow flight☆39Updated 5 years ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆160Updated 3 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 3 years ago
- Skeleton project for Apache Airflow training participants to work on.☆17Updated 5 years ago
- Open-source metadata collector based on ODD Specification☆44Updated 2 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆181Updated last month
- A library for Spark DataFrame using MinIO Select API☆99Updated 6 years ago