adidas / m3d-apiLinks
Metadata Driven Development (m3d) is a cloud and platform agnostic framework for the automated creation, management and governance of data lakes.
☆32Updated 2 years ago
Alternatives and similar repositories for m3d-api
Users that are interested in m3d-api are comparing it to the libraries listed below
Sorting:
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- ☆97Updated 2 years ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆159Updated 2 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆76Updated last week
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated this week
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆113Updated last month
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated this week
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 4 years ago
- M3D Engine is a Spark application for the development of scalable data transformations and ingestions in data lakes.☆18Updated 4 years ago
- New generation opensource data stack☆72Updated 3 years ago
- Egeria's Guidance on Governance as well as large media files such as presentations and movies☆106Updated 2 years ago
- Tool to automate data quality checks on data pipelines☆254Updated 3 years ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆165Updated 2 weeks ago
- Big Data Demystified meetup and blog examples☆31Updated last year
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆348Updated last week
- Dremio Flight connector. Access Dremio using Arrow flight☆40Updated 4 years ago
- A curated list of dagster code snippets for data engineers☆57Updated last year
- Superset Quick Start Guide, published by Packt☆56Updated last year
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆38Updated 4 years ago
- Data Tools Subjective List☆86Updated 2 years ago
- Data Profiler for AWS Glue Data Catalog application as described in the AWS Big Data Blog post "Build an automatic data profiling and rep…☆20Updated 5 years ago
- Airflow declarative DAGs via YAML☆133Updated 2 years ago
- DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.☆267Updated 5 months ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆80Updated 2 weeks ago
- a collection of resources and blogs about Apache Superset☆86Updated 3 years ago
- A curated list of awesome Databricks resources, including Spark☆21Updated last year
- Build DataOps platform with Apache Airflow and dbt on AWS☆59Updated 4 years ago
- Code examples for the Introduction to Kubeflow course☆14Updated 4 years ago