Alternatives and similar repositories for data-mesh

Users that are interested in data-mesh are comparing it to the libraries listed below

• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated 2 years ago
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆267Updated 6 months ago
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• apache / incubator-liminal
  Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …
  ☆144Updated last year
• CybercentreCanada / jupyterlab-sql-editor
  A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino
  ☆90Updated last week
• datacamp / viewflow
  Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
  ☆126Updated 4 years ago
• elyra-ai / airflow-notebook
  This repository is no longer maintained.
  ☆15Updated 3 years ago
• opendatadiscovery / odd-collector
  Open-source metadata collector based on ODD Specification
  ☆44Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• mark-hoffmann / fastteradata
  Tools for faster and optimized interaction with Teradata and large datasets.
  ☆17Updated 7 years ago
• MrPowers / farsante
  Fake Pandas / PySpark DataFrame creator
  ☆48Updated last year
• voltrondata / superset-sqlalchemy-adbc-flight-sql-poc
  A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.
  ☆25Updated 2 years ago
• ibis-project / ibis-analytics
  Ibis analytics, with Ibis (and more!)
  ☆22Updated last year
• sodadata / soda-sql
  Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html
  ☆62Updated 2 years ago
• fugue-project / tutorials
  Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…
  ☆114Updated last year
• jason-jz-zhu / databathing
  ☆22Updated last month
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 5 years ago
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated 2 years ago
• victorcouste / data-tools
  Data Tools Subjective List
  ☆86Updated 2 years ago
• patterns-app / patterns-devkit
  Data pipelines from re-usable components
  ☆107Updated 2 years ago
• level-vc / useful
  The open-source Useful SDK. One python decorator in the Useful library allows for full observability of Python functions within an ETL.
  ☆19Updated last year
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated 2 weeks ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated 2 weeks ago
• gtoonstra / sqlineage
  A parser for SQL, which gives back identifiers and a hierarchical model for lineage tracking
  ☆20Updated 7 years ago
• deepsense-ai / seahorse
  ☆107Updated 2 years ago
• 173TECH / sayn
  Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
  ☆120Updated 3 weeks ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆144Updated last year
• aivanzhang / panda_patrol
  ☆23Updated last year
• project-thirdeye / thirdeye
  ThirdEye is an integrated tool for realtime monitoring of time series and interactive root-cause analysis. It enables anyone inside an or…
  ☆95Updated 2 years ago
• jorgecarleitao / arrowdantic
  Arrow, pydantic style
  ☆85Updated 2 years ago