georgezefko / mage_projectsLinks
Data Engineering Projects using Mage.ai as orchestrator
☆16Updated 4 months ago
Alternatives and similar repositories for mage_projects
Users that are interested in mage_projects are comparing it to the libraries listed below
Sorting:
- DataOps Data Quality TestGen is part of DataKitchen's Open Source Data Observability. DataOps TestGen delivers simple, fast data qualit…☆64Updated last week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆168Updated this week
- Test data management tool for any data source, batch or real-time. Generate, validate and clean up data all in one tool.☆69Updated last week
- ☆13Updated 2 years ago
- A write-audit-publish implementation on a data lake without the JVM☆46Updated last year
- ☆20Updated last year
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆30Updated this week
- The Open-Source Enterprise Data Platform in a single Portal☆258Updated this week
- Installer for DataKitchen's Open Source Data Observability Products. Data breaks. Servers break. Your toolchain breaks. Ensure your team …☆128Updated last week
- Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.☆154Updated this week
- SQLMesh example projects☆36Updated 3 months ago
- The Data Product Descriptor Specification (DPDS) Repository☆80Updated 9 months ago
- This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. Ther…☆24Updated last month
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆45Updated 11 months ago
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆30Updated last year
- dlt-dagster-demo☆12Updated last year
- Data Mesh Manager (Community Edition)☆48Updated 6 months ago
- ODD Specification is a universal open standard for collecting metadata.☆143Updated 11 months ago
- The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and eg…☆32Updated 4 months ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆77Updated this week
- Yet Another (Spark) ETL Framework☆21Updated last year
- A platform and cloud-based service for data sharing based on the Delta Sharing protocol.☆21Updated last year
- ☆39Updated 6 months ago
- Arcane Insight is a data analytics project designed to harness the power of SQLMesh & DuckDB to collect, transform, and analyze data from…☆35Updated 8 months ago
- A platform to manage the data product life cycle☆20Updated this week
- DataOps Observability Integration Agents are part of DataKitchen's Open Source Data Observability. They connect to various ETL, ELT, BI, …☆31Updated 2 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated 2 weeks ago
- A Model Context Protocol (MCP) server for discovering data products and requesting access in Data Mesh Manager, and executing queries on …☆39Updated last week
- Data product portal created by Dataminded☆192Updated this week
- How to evaluate the Quality of your Data with Great Expectations and Spark.☆31Updated 2 years ago