adidas / m3d-api
Metadata Driven Development (m3d) is a cloud and platform agnostic framework for the automated creation, management and governance of data lakes.
☆31Updated last year
Alternatives and similar repositories for m3d-api:
Users that are interested in m3d-api are comparing it to the libraries listed below
- M3D Engine is a Spark application for the development of scalable data transformations and ingestions in data lakes.☆18Updated 3 years ago
- A curated list of awesome Databricks resources, including Spark☆17Updated 10 months ago
- Universal interface for data services☆15Updated 2 years ago
- A Table format agnostic data sharing framework☆38Updated last year
- 📆 Run, schedule, and manage your dbt jobs using Kubernetes.☆24Updated 6 years ago
- Code that was used as an example during the Data+AI Summit 2020☆15Updated 4 years ago
- A Scalable Data Cleaning Library for PySpark.☆27Updated 6 years ago
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆19Updated 4 years ago
- ☆96Updated last year
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- Utility functions for dbt projects running on Spark☆32Updated 2 months ago
- Spark app to merge different schemas☆23Updated 4 years ago
- dbt package for monitoring airflow DAGs and tasks☆29Updated 2 months ago
- Full stack data engineering tools and infrastructure set-up☆52Updated 4 years ago
- Example project using DBT, Databricks and AdventureWorks sample database☆11Updated 2 years ago
- Yet Another (Spark) ETL Framework☆21Updated last year
- Distributed Data Mesh 2.0 | DataMesh-as-a-Code on Cloud | Theory to Industrialization☆37Updated 2 years ago
- Unity Catalog UI☆40Updated 7 months ago
- ☆13Updated last year
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆94Updated this week
- Drag N Drop WepApp to Build and Manage Airflow DAGs☆25Updated 2 years ago
- ☆11Updated 5 months ago
- Delta Lake Documentation☆49Updated 10 months ago
- ☆19Updated 4 years ago
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- ☆17Updated 8 months ago
- A plugin for Airflow that create and manage your DAG with web UI.☆20Updated 7 years ago
- Awesome list of dataops products, open source and resources☆24Updated 2 years ago
- Hackney Data Platform Infrastructure and Code☆17Updated this week