Alternatives and similar repositories for incubator-liminal

Users that are interested in incubator-liminal are comparing it to the libraries listed below

• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆96Updated last month
• linkedin / datahub-gma
  General Metadata Architecture
  ☆134Updated last week
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆233Updated 9 months ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆159Updated 2 years ago
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆267Updated 7 months ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆346Updated last year
• startreedata / thirdeye
  ThirdEye is an integrated tool for realtime monitoring of time series and interactive root-cause analysis.
  ☆105Updated 6 months ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆72Updated 3 years ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆102Updated 2 years ago
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated 2 years ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆326Updated 2 years ago
• cuebook / cuelake
  Use SQL to build ELT pipelines on a data lakehouse.
  ☆288Updated 3 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated last month
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆230Updated 2 weeks ago
• project-thirdeye / thirdeye
  ThirdEye is an integrated tool for realtime monitoring of time series and interactive root-cause analysis. It enables anyone inside an or…
  ☆94Updated 3 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆204Updated last year
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆136Updated 2 years ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated last week
• Hydrospheredata / hydro-serving
  MLOps Platform
  ☆272Updated last year
• allegro / bigflow
  A Python framework for data processing on GCP.
  ☆119Updated 7 months ago
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆107Updated this week
• airbnb / sputnik
  ☆63Updated 6 years ago
• apple / batch-processing-gateway
  The gateway component to make Spark on K8s much easier for Spark users.
  ☆205Updated last month
• linkedin / dynoyarn
  DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.
  ☆61Updated 2 years ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆63Updated this week
• lightbend / kubeflow-recommender
  Kubeflow example of machine learning/model serving
  ☆37Updated 5 years ago
• datacamp / viewflow
  Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
  ☆125Updated 4 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆96Updated 5 years ago
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year