Alternatives and similar repositories for incubator-liminal:

Users that are interested in incubator-liminal are comparing it to the libraries listed below

• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆94Updated this week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆224Updated last month
• delta-incubator / deltatorch
  ☆57Updated last year
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆71Updated 2 years ago
• linkedin / datahub-gma
  General Metadata Architecture
  ☆124Updated this week
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆121Updated this week
• logicalclocks / feature-store-api
  Python - Java/Scala API for the Hopsworks feature store
  ☆54Updated last month
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆345Updated 10 months ago
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆98Updated this week
• apple / batch-processing-gateway
  The gateway component to make Spark on K8s much easier for Spark users.
  ☆186Updated 2 months ago
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆153Updated last year
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆245Updated 2 weeks ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆98Updated 2 years ago
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• acryldata / datahub-actions
  DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.
  ☆47Updated last week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆120Updated 3 weeks ago
• ray-project / deltacat
  A portable Pythonic Data Lakehouse powered by Ray that brings exabyte-level scalability and fast, ACID-compliant, change-data-capture to …
  ☆205Updated this week
• mlrun / storey
  real-time data + ML pipeline
  ☆54Updated 2 weeks ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 2 years ago
• linkedin / dynoyarn
  DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.
  ☆60Updated 2 years ago
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆192Updated last month
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆181Updated 3 weeks ago
• japila-books / pyspark-internals
  The Internals of PySpark
  ☆26Updated 3 months ago
• airbnb / sputnik
  ☆63Updated 5 years ago
• delta-incubator / deltaray
  Delta reader for the Ray open-source toolkit for building ML applications
  ☆45Updated last year
• getindata / kafka-connect-iceberg-sink
  ☆79Updated this week
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• oap-project / raydp
  RayDP provides simple APIs for running Spark on Ray and integrating Spark with AI libraries.
  ☆331Updated this week
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆87Updated 4 years ago