adidas / m3d-apiLinks
Metadata Driven Development (m3d) is a cloud and platform agnostic framework for the automated creation, management and governance of data lakes.
☆33Updated 2 years ago
Alternatives and similar repositories for m3d-api
Users that are interested in m3d-api are comparing it to the libraries listed below
Sorting:
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆76Updated this week
- M3D Engine is a Spark application for the development of scalable data transformations and ingestions in data lakes.☆18Updated 4 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated last week
- ODD Specification is a universal open standard for collecting metadata.☆143Updated 11 months ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 3 weeks ago
- Egeria's Guidance on Governance as well as large media files such as presentations and movies☆106Updated 2 years ago
- a collection of resources and blogs about Apache Superset☆87Updated 3 years ago
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆64Updated this week
- ☆97Updated 2 years ago
- Beneath is a serverless real-time data platform ⚡️☆84Updated 3 years ago
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆349Updated this week
- New generation opensource data stack☆73Updated 3 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆167Updated last month
- DataOps Observability Integration Agents are part of DataKitchen's Open Source Data Observability. They connect to various ETL, ELT, BI, …☆31Updated 2 months ago
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆113Updated 2 months ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆81Updated 2 weeks ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆159Updated 2 years ago
- A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀☆34Updated 3 years ago
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆38Updated 4 years ago
- Superset Quick Start Guide, published by Packt☆56Updated last year
- A small Python module containing quick utility functions for standard ETL processes.☆36Updated last month
- A curated list of awesome Databricks resources, including Spark☆21Updated last year
- real-time data + ML pipeline☆54Updated this week
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆20Updated 5 years ago
- Data Tools Subjective List☆86Updated 2 years ago
- Data science, machine learning tools on the cloud☆15Updated 4 years ago