Alternatives and similar repositories for data-mesh

Users that are interested in data-mesh are comparing it to the libraries listed below

• apache / incubator-liminal
  Apache Liminals goal is to operationalise the machine learning process, allowing data scientists to quickly transition from a successful …
  ☆144Updated last year
• tubular / sparkly
  Helpers & syntactic sugar for PySpark.
  ☆62Updated 2 years ago
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆267Updated 5 months ago
• criteo / cluster-pack
  A library on top of either pex or conda-pack to make your Python code easily available on a cluster
  ☆45Updated this week
• datafusion-contrib / datafusion-python
  Python binding for DataFusion
  ☆59Updated 3 years ago
• xdssio / big_data_benchmarks
  big data technologies comparisons for cleaning, manipulating and generally wrangling data in purpose of analysis and machine learning.
  ☆65Updated 5 years ago
• dask-contrib / dask-snowflake
  Dask integration for Snowflake
  ☆30Updated last month
• dask / dask-yarn
  Deploy dask on YARN clusters
  ☆69Updated last year
• elyra-ai / airflow-notebook
  This repository is no longer maintained.
  ☆15Updated 3 years ago
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated last year
• CybercentreCanada / jupyterlab-sql-editor
  A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino
  ☆89Updated last week
• zero323 / pyspark-asyncactions
  Asynchronous actions for PySpark
  ☆47Updated 3 years ago
• logicalclocks / feature-store-api
  Python - Java/Scala API for the Hopsworks feature store
  ☆54Updated last month
• dbt-labs / dbt-presto
  [ARCHIVED] The Presto adapter plugin for dbt Core
  ☆33Updated last year
• 173TECH / sayn
  Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
  ☆120Updated this week
• jorgecarleitao / arrowdantic
  Arrow, pydantic style
  ☆84Updated 2 years ago
• hi-primus / bumblebee
  🚕 A spreadsheet-like data preparation web app that works over Optimus (Pandas, Dask, cuDF, Dask-cuDF, Spark and Vaex)
  ☆141Updated 2 years ago
• victorcouste / data-tools
  Data Tools Subjective List
  ☆87Updated 2 years ago
• patterns-app / patterns-devkit
  Data pipelines from re-usable components
  ☆107Updated 2 years ago
• jcrist / skein
  A tool and library for easily deploying applications on Apache YARN
  ☆144Updated last year
• jeppe742 / DeltaLakeReader
  Read Delta tables without any Spark
  ☆47Updated last year
• allwefantasy / pyjava
  This library is an ongoing effort towards bringing the data exchanging ability between Java/Scala and Python. PyJava introduces Apache A…
  ☆49Updated 2 years ago
• youngwookim / awesome-presto
  A curated list of awesome PrestoDB / Trino software, libraries, tools and resources
  ☆17Updated 4 years ago
• voltrondata / superset-sqlalchemy-adbc-flight-sql-poc
  A proof-of-concept repo that attempts to use Apache Superset with a custom ADBC to Arrow Flight SQL SQLAlchemy driver.
  ☆25Updated 2 years ago
• getindata / kedro-kubeflow
  Kedro Plugin to support running workflows on Kubeflow Pipelines
  ☆55Updated 2 months ago
• zero323 / pyspark-stubs
  Apache (Py)Spark type annotations (stub files).
  ☆117Updated 3 years ago
• fal-ai / dbt_feature_store
  Build your feature store with macros right within your dbt repository
  ☆39Updated 2 years ago
• mlrun / storey
  real-time data + ML pipeline
  ☆54Updated last week
• gtoonstra / sqlineage
  A parser for SQL, which gives back identifiers and a hierarchical model for lineage tracking
  ☆20Updated 7 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆96Updated 4 years ago