Alternatives and similar repositories for flowman

Users that are interested in flowman are comparing it to the libraries listed below

• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated 3 weeks ago
• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆122Updated this week
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆233Updated 8 months ago
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆102Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆231Updated 3 months ago
• intuit / superglue
  Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …
  ☆159Updated 2 years ago
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆104Updated last month
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆72Updated 3 years ago
• TrivadisPF / platys-modern-data-platform
  Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....
  ☆77Updated this week
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆60Updated 2 years ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆346Updated last year
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆588Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆129Updated last month
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 6 months ago
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆287Updated this week
• agile-lab-dev / DataQuality
  DataQuality for BigData
  ☆144Updated last year
• airbnb / sputnik
  ☆63Updated 5 years ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆40Updated last year
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆196Updated this week
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• cuebook / cuelake
  Use SQL to build ELT pipelines on a data lakehouse.
  ☆288Updated 3 years ago
• tokern / data-lineage
  Generate and Visualize Data Lineage from query history
  ☆326Updated 2 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated last week
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆198Updated this week
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆267Updated 6 months ago
• projectnessie / nessie-demos
  Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.
  ☆30Updated last week
• apache / incubator-datalab
  Apache DataLab (incubating)
  ☆152Updated 2 years ago
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆186Updated 9 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆230Updated last week