Alternatives and similar repositories for incubator-liminal:

Users that are interested in incubator-liminal are comparing it to the libraries listed below

• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆94Updated this week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆345Updated 8 months ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆70Updated 2 years ago
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆118Updated 3 weeks ago
• delta-incubator / deltatorch
  ☆54Updated last year
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆44Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆178Updated last week
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆95Updated this week
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆191Updated last week
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆224Updated 2 months ago
• linkedin / datahub-gma
  General Metadata Architecture
  ☆123Updated this week
• linkedin / transport
  A framework for writing performant user-defined functions (UDFs) that are portable across a variety of engines including Apache Spark, Ap…
  ☆299Updated last year
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆214Updated 2 months ago
• getindata / kafka-connect-iceberg-sink
  ☆79Updated last year
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆183Updated last month
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆97Updated 2 years ago
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆86Updated 4 years ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆317Updated last year
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆118Updated this week
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• dremio-hub / arrow-flight-client-examples
  ☆68Updated last month
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆75Updated this week
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆250Updated last year
• dataflint / spark
  Performance Observability for Apache Spark
  ☆224Updated 2 weeks ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆62Updated 2 months ago
• linkedin / dynoyarn
  DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.
  ☆58Updated last year
• apple / batch-processing-gateway
  The gateway component to make Spark on K8s much easier for Spark users.
  ☆184Updated 2 weeks ago
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆171Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆171Updated 3 weeks ago