adidas / m3d-apiLinks
Metadata Driven Development (m3d) is a cloud and platform agnostic framework for the automated creation, management and governance of data lakes.
☆33Updated 2 years ago
Alternatives and similar repositories for m3d-api
Users that are interested in m3d-api are comparing it to the libraries listed below
Sorting:
- M3D Engine is a Spark application for the development of scalable data transformations and ingestions in data lakes.☆19Updated 4 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆80Updated last week
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆127Updated 4 years ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 5 years ago
- Full stack data engineering tools and infrastructure set-up☆57Updated 4 years ago
- A Scalable Data Cleaning Library for PySpark.☆29Updated 6 years ago
- Egeria's Guidance on Governance as well as large media files such as presentations and movies☆107Updated 3 years ago
- Auto-generated Diagrams from Airflow DAGs. 🔮 🪄☆355Updated last week
- ☆100Updated 2 years ago
- A curated list of awesome Databricks resources, including Spark☆22Updated last year
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆70Updated last month
- ODD Specification is a universal open standard for collecting metadata.☆146Updated last year
- Ansible roles to deploy Kubernetes, JupyterHub, Jupyter Enterprise Gateway and Spark on Kubernetes cluster☆37Updated 5 years ago
- Sample configuration to deploy a modern data platform.☆89Updated 4 years ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆97Updated last week
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated last week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆181Updated last month
- Awesome list of dataops products, open source and resources☆24Updated 3 years ago
- ☆36Updated 10 months ago
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 4 months ago
- Metamapper is a data discovery and documentation platform for improving how teams understand and interact with their data.☆81Updated 2 weeks ago
- Dremio Container Tools☆164Updated 5 months ago
- DataOps Observability Integration Agents are part of DataKitchen's Open Source Data Observability. They connect to various ETL, ELT, BI, …☆31Updated 6 months ago
- Tool to automate data quality checks on data pipelines☆257Updated 3 years ago
- Data Catalog for Databases and Data Warehouses☆36Updated 2 years ago
- a collection of resources and blogs about Apache Superset☆88Updated 4 years ago
- ☆113Updated last year
- Python ELT Studio, an application for building ELT (and ETL) data flows.☆58Updated 4 years ago
- A curated list of awesome open source tools and commercial products to catalog, version, and manage data 🚀☆39Updated 3 years ago
- dbd is a database prototyping tool that enables data analysts and engineers to quickly load and transform data in SQL databases.☆57Updated 3 years ago