adidas / m3d-apiLinks
Metadata Driven Development (m3d) is a cloud and platform agnostic framework for the automated creation, management and governance of data lakes.
☆33Updated 2 years ago
Alternatives and similar repositories for m3d-api
Users that are interested in m3d-api are comparing it to the libraries listed below
Sorting:
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆125Updated 4 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆20Updated 5 years ago
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆77Updated last week
- ☆97Updated 2 years ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated last month
- M3D Engine is a Spark application for the development of scalable data transformations and ingestions in data lakes.☆18Updated 4 years ago
- A Scalable Data Cleaning Library for PySpark.☆29Updated 6 years ago
- Egeria's Guidance on Governance as well as large media files such as presentations and movies☆106Updated 3 years ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 5 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆171Updated 3 weeks ago
- ☆35Updated 7 months ago
- Big Data Demystified meetup and blog examples☆31Updated last year
- ODD Specification is a universal open standard for collecting metadata.☆144Updated last year
- Superset Quick Start Guide, published by Packt☆56Updated last year
- Tool to automate data quality checks on data pipelines☆253Updated 3 years ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆81Updated last month
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆159Updated 2 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆113Updated 3 months ago
- Simple samples for writing ETL transform scripts in Python☆24Updated 3 months ago
- Code examples for the Introduction to Kubeflow course☆14Updated 4 years ago
- Data pipelines from re-usable components☆107Updated 2 years ago
- a collection of resources and blogs about Apache Superset☆88Updated 3 years ago
- DataOps Observability Integration Agents are part of DataKitchen's Open Source Data Observability. They connect to various ETL, ELT, BI, …☆31Updated 3 months ago
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆65Updated 3 weeks ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆352Updated this week
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- Basin is a visual programming editor for building Spark and PySpark pipelines. Easily build, debug, and deploy complex ETL pipelines from…☆35Updated 2 years ago
- 🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)☆141Updated 2 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated last month