Alternatives and similar repositories for incubator-liminal

Users that are interested in incubator-liminal are comparing it to the libraries listed below

• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆344Updated last year
• linkedin / datahub-gma
  General Metadata Architecture
  ☆125Updated last week
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆94Updated last week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 3 years ago
• delta-incubator / deltatorch
  ☆58Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆224Updated 2 months ago
• startreedata / thirdeye
  ThirdEye is an integrated tool for realtime monitoring of time series and interactive root-cause analysis.
  ☆101Updated last month
• apple / batch-processing-gateway
  The gateway component to make Spark on K8s much easier for Spark users.
  ☆192Updated last month
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• linkedin / dynoyarn
  DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.
  ☆60Updated 2 years ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated 2 weeks ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆228Updated 4 months ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆78Updated last month
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated last month
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆157Updated 2 years ago
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆89Updated 4 years ago
• acryldata / datahub-actions
  DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.
  ☆46Updated last month
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆97Updated this week
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆98Updated 2 years ago
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆35Updated 8 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated this week
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆46Updated last year
• logicalclocks / feature-store-api
  Python - Java/Scala API for the Hopsworks feature store
  ☆54Updated last week
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆184Updated 4 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆59Updated last year
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆193Updated this week
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆353Updated this week
• getindata / kafka-connect-iceberg-sink
  ☆80Updated last month
• linkedin / transport
  A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…
  ☆299Updated last year