Alternatives and similar repositories for incubator-liminal

Users that are interested in incubator-liminal are comparing it to the libraries listed below

• linkedin / datahub-gma
  General Metadata Architecture
  ☆135Updated last week
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆97Updated this week
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated 11 months ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆346Updated last year
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆267Updated 9 months ago
• itsjafer / jupyterlab-sparkmonitor
  JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
  ☆92Updated 3 years ago
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆72Updated 3 years ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated 3 months ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆160Updated 3 years ago
• cuebook / cuelake
  Use SQL to build ELT pipelines on a data lakehouse.
  ☆288Updated 3 years ago
• linkedin / dynoyarn
  DynoYARN is a framework to run simulated YARN clusters and workloads for YARN scale testing.
  ☆60Updated 2 years ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆103Updated 2 years ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆61Updated 2 years ago
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated 2 years ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆327Updated 2 years ago
• TrivadisPF / platys-modern-data-platform
  Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
  ☆78Updated this week
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated last year
• startreedata / thirdeye
  ThirdEye is an integrated tool for realtime monitoring of time series and interactive root-cause analysis.
  ☆109Updated 8 months ago
• datacamp / viewflow
  Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
  ☆126Updated 4 years ago
• aws-samples / eks-spark-benchmark
  Performance optimization for Spark running on Kubernetes
  ☆89Updated 5 years ago
• amundsen-io / amundsendatabuilder
  Data ingestion library for Amundsen to build graph and search index
  ☆204Updated last year
• airbnb / sputnik
  ☆63Updated 6 years ago
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆109Updated last month
• linkedin / iceberg
  A home for LinkedIn's changes to Apache Iceberg
  ☆63Updated last week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated this week
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆122Updated this week
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated this week
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆187Updated last month
• Hydrospheredata / hydro-serving
  MLOps Platform
  ☆272Updated last year
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆201Updated last month