Alternatives and similar repositories for flowman:

Users that are interested in flowman are comparing it to the libraries listed below

• smart-data-lake / smart-data-lake
  Smart Automation Tool for building modern Data Lakes and Data Pipelines
  ☆120Updated this week
• arempter / hive-metastore-docker
  Example for article Running Spark 3 with standalone Hive Metastore 3.0
  ☆97Updated 2 years ago
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆219Updated this week
• jaceklaskowski / spark-kubernetes-book
  The Internals of Spark on Kubernetes
  ☆70Updated 2 years ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆176Updated last week
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆95Updated this week
• sibytes / yetl
  Yet Another (Spark) ETL Framework
  ☆20Updated last year
• japila-books / delta-lake-internals
  The Internals of Delta Lake
  ☆183Updated 2 months ago
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆180Updated 2 weeks ago
• getindata / kafka-connect-iceberg-sink
  ☆79Updated last year
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆91Updated last year
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆120Updated 2 weeks ago
• yaooqinn / itachi
  A library that brings useful functions from various modern database management systems to Apache Spark
  ☆58Updated last year
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆191Updated 2 weeks ago
• AbsaOSS / hyperdrive
  Extensible streaming ingestion pipeline on top of Apache Spark
  ☆44Updated 11 months ago
• swoop-inc / spark-alchemy
  Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
  ☆185Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆63Updated 2 years ago
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆83Updated this week
• CoxAutomotiveDataSolutions / waimak
  Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
  ☆75Updated 10 months ago
• unitycatalog / unitycatalog-ui
  Unity Catalog UI
  ☆39Updated 6 months ago
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆345Updated 9 months ago
• holdenk / spark-flowchart
  Flowchart for debugging Spark applications
  ☆105Updated 5 months ago
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆222Updated 3 months ago
• rajagurunath / lakehouse-sharing
  A Table format agnostic data sharing framework
  ☆38Updated last year
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆176Updated this week
• holdenk / spark-upgrade
  Magic to help Spark pipelines upgrade
  ☆34Updated 5 months ago
• linkedin / iceberg
  A temporary home for LinkedIn's changes to Apache Iceberg (incubating)
  ☆62Updated 3 months ago
• SaurabhChawla100 / spark-radiant
  Spark-Radiant is Apache Spark Performance and Cost Optimizer
  ☆25Updated 2 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆206Updated 2 weeks ago
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆76Updated 3 weeks ago